difference between "SJWs" and Richard Spencer is that Richard Spencer is actively attempting to organize a movement that advocates for genocide
like i don't think you understand the gravity of a situation in which somebody who is 100% pro-genocide consistently organizes events in order to publicly form a group of people who will agree with him. you lose the right to people protecting your feelings when you actively attempt to organize an ethnic cleansing.
i don't think you understand how freedom of speech works
as you can see, he's not exactly a powerful person. neo-national socialistsm is not a significant threat to society.
the reason we only only denounce direct threats (e.g. (at gun point) "do this or i shoot you") is because a hardline declaration of freedom of representation prevents groups from being directly silenced, no matter how corrupt or power-hungry the govt tries to become