There's a problem in your logic. A few times today, I've seen you use the excuse "We have more players." Just because there are more, does there mean there are more
good ones? Like you just said;
Someone has to deal with the handicaps.
There are annoying handicaps on your game. So, just because you have more, doesn't mean you have more that are good.