The lag comes intensely at random intervals. I can't say what the source is, but a server will be fine for a while and then bottom out for a minute or two. However, there are days when all your servers go lag free. It just seems that your provider sometimes has issues or whatnot - I cannot say.
I have been considering getting a server in the distant future, but it would more than likely exceed Ram limitations, especially when hosted with many people.