It is because the point of the input events is to have a specific action trigger the following. If no actual action is being performed, such as just looking at the brick, it is not input. The server would need to constantly check each client to see if they are looking at a brick that has an OnPlayerSee input event.