When saving bricks you need to make sure to save ownership, you also have to load ownership when loading bricks. It is very easy to accidentally not have these settings on.
The problem is If you want to drive or pick up a weapon, the message will popup saying "[Brick Owner] Does not Trust enough to do that" and most events could be lost. It's very annoying and It will not go away.