As long as they live in your country, or a country within like 5K miles, and if your internet is good, there will be no problem.
I live on the East Coast. I get pings of 5-100 anywhere in the USA. I get 120 in Germany, and about 250 in Japan.
Lag is never a problem unless you are on a 56K modem or if the server is bad.