Spanish?

This cat said I claimed Spain like so many Hispanics do. But I specifically said that I have no idea about my actual European Spanish ancestry and therefore I don't claim Spain. So I don't claim Spain. Moreover, I hate to be called Spanish because I'm not from Spain and neither are either of my parents nor any of my grandparents.
If we're called Spanish because we speak Spanish then how come the blacks of Haiti and Ghana are not called French or English since they speak French or English? In fact, Haitians and Africans are called either Francophone or Anglophone (besides what they actually are, Senegalese, Malian, Nigerian, Congolese, Gambian, Zimbabwean, etc). WHY ARE WE NOT CALLED HISPANOPHONE plain and simple and nothing else (except for what we actually are, Puerto Rican, Dominican, Cuban, Mexican, Colombian, Venezuelan, etc). How come Anglo-Saxon-Celtic Yankees of New England who are racially the same as the English/the British and speak English (such as my dad) are not called English?
It seems to me that my fellow Americans want to reserve the terms English and French FOR WHITES ONLY while they feel they have to DE-WHITEN the term Spanish by applying to all of us "nonwhites" (I include myself using the Race Card Group and the white American definition of whiteness) regardless of our actual connection to Spain.