If you are loading it from a save file, I believe they must join the server at least once for the trust settings to be applied.