The OP makes a good point. I think being poor, overweight, bad at English, and probably many other characteristics that I can't think of at the moment are much more likely to get you discriminated against than being an URM. Unfortunately, those characteristics are much more subjective, or shall we say, not as 'black and white' (pun intended.)