To add to that, it's your server, you're the one putting the time and energy into hosting it. If you don't like somebody and don't want them in your server, they are not entitled to playing on your server.
But yeah like it was said before it is still stuffty to ban people you have a grudge with from other people's servers without running it by the host first.