that is what im saying, the servers constantly changing the clients fov which would be really hacky
Not really no. There are few circumstances in which the client modifies its FOV on its own, such as zooming and etc. That's the only time it would reveal itself.
You know, outside the FOV being crap.