If you want people to be able to see your build in-game, your server must transmit information as to the position, size, rotation and colour of the bricks. This is unavoidable unless you want it to be an invisible mess with glitchy collisions. This information can be saved no matter what you do.
If you don't want people to be able to get this information then don't host a server.