No actually, it's your fault for enforcing an unobtainable rule of not DM-ing that all your guests expect to be under protection of, but because you don't hardly moderate the server, they are denied that respect and therefore yell at you.
It's your fault.