Well if everyone were as dumb as you've just described them, then yeah. Luckily though, there are a a number of people with good heads on their shoulders trying to move the main focus of race out of existence completely.
It's also extremely easy to not be an ass to other people who are different than you.