It looks fine in first person, but in third person, not so much.
Isn't there a way to show a different model for the view model and world model?
You can always just have the first-person view with the centered weapon and the weapon being held regularly in third person.