If you load a build, that you cannot fully see from where you spawn, the bricks that you cannot see don't load. If you save your build that way, it gets rid of them.
You have to go around all your build and let it load. Bricks that you cant see due to being too far away, won't load till your nearer to them. Its the games way of reducing lag.