Player clicks the mouse with no tools
This sends a message to the server, which repeats it to all players that they may be trying to pick up a brick
EACH CLIENT COPY checks all physics bricks in front of the client to see if they can be picked up
If it is, brick hovers in front of that player until they release it, otherwise ignore (e.g. lag)
Result: "picking up bricks", appears fine clientsided, with no errors and few messages
If there is lag or disconnection between clients and a brick appears out of place, they won't pick it up for anyone out of sync. Simple.
This method also fixes the problem of the server not being able to see if you can pick up the brick: it doesn't have to.