New theory:
The amout of problems is semi-proportional to the amout of admins. At this moment it's like nearly every single admin caused problems in one or another way. May it be abusing, stupid kicks/bans, whatever.
Moonlight and I had a really nice idea actually. Only allowing certain people on the server. Not passworded, a list. People who are not on the list simply can't join. Now, that idea doesn't appear to be that bad...