But you need to. If you took a slave and a slave owner and asked them for their opinions, you'd get this:
Slave: I've been oppressed my entire life and treated like dirt
Slave owner: Black people aren't people and should be enslaved by us superior whites.
The core of the issue is purely racial, and the slave's opinion is more qualified because they are experiencing the racial issue. In this case, the racial issue is directed against one race, so whoever is on the receiving side of the racial issue has the say because they are the victim.
In the case of saying 'monday' it's just an overall offensive and insulting word. Not even black people use it, unless they're joking or something. It's just wrong to say in general, and you don't need a qualified person to prove that.
No if you asked a salve and a slave owner their opinions you'd get nothing because Slavery doesn't exist anymore (In the United States.), and anyone who would have been alive to be directly influenced by this are long dead. (Also, holy stuff, talk about a "the worst situation was the common situation." mindset. Yes slaver was bullstuff, but forget mate, those are extreme views for the slave owner. Surprisingly, not all people who owned slaves hated black people, but this is getting way off track.)
Also, you're saying that only the 'determined victim' will have a valid opinion on racial issues, but I feel as though letting a single representive cover an entire race is also not right.
And yes, other opinions are important, because that will let you determine for yourself, who is in the right, and who is in the wrong.
Example here:
https://www.youtube.com/watch?v=vZCVHB68cuY