Or just don't use the moderator add-on.
Someone with only the power to kick is completely worthless. It's like a cop that can only keep someone in jail as long as he's on his shift. Once he goes home, the criminal is allowed to roam the streets again.
If you have an admin that bans people for wrong reasons, get rid of him. Get a new one. If they complain, tell them you're the host and they're not listening to you.