Not really, not by itself.
But the question is, if you know they are bad people why do you want to hang around them?
You're only going to end up clumped together with them, regardless of your actions.
I would have thought this would be an obvious answer here, given the ridiculous "clubs" of people we've had who've tried to attack the game, community and members. There were some members of those groups who weren't as bad as others, but hanging around with them got those people a bad name.