If all you are going to be doing is hosting servers with it, that computer is a good start, but you could certainly get better. Here are my tips. You need a good CPU and a most likely 8GB or more of ram, depending on how many players you expect to host at a time. Don't bother with putting cash into graphics as servers don't really need graphics processing. That being said, an APU may not be the best thing for a server. Get the cheapest case, new or used.
I'll be using the computer for some other stuff, but not too CPU intensive stuff, like programming and such. And I guess I can upgrade easily. Thanks for the suggestion.
Also does it come with all the plugs necessary and all I need to get is a monitor?