You can do either of two things:
1) Set the max players for the second team to 1.
2) Increase the first team's auto sort weight. For example, if you set it to 5, when team1 has 5 players, team2 will have 1, and when team1 has 10 players, team2 will have 2 players. It's a ratio.