I just figured out why it was taking hours to start up a server. After looking in the console, I found that the game was finding every single UnPn Adress (Universal Plug and Play) ever connected to me ever, I switched off hamachi, since Unpn is basically lan, and It started up super fast.
So, if anyone else is having that sort of problem, there's your solution.