but the amount of servers is crazy compared to the amount of people playing
True, but even if a server is setup, it doesn't mean you can always join.
For example, if you have not port-forwarded, others cannot join your server. The server still shows up on the list though. I'm pretty sure people are just playing around, learning how to use the game.
Update: Heed's server disconnected also