Because not everyone has athletic hobbies that they grew up with. Some grew up enjoying more aesthetic things and less athletic. But how would it be fair if only some kids had to take a stuffty-ass class? That doesn't mean being "sensitive", that's just using logic. Plus, "gym" is too inconsistent. There is not much of a defined curriculum for gym, so they can't really give skill grades.