The only way that I can think of to accomplish this, would be to not send brick ghost objects to clients.
This is ridiculous because then, not only can people not save the bricks, but they cannot see them, or know that they are there, which in turn completely throws off interpolation (hence the "bouncing" while you are standing on top of bricks you have not yet ghosted).