It's most likely because I did not act on that knowledge. My character continued to sit on the walls waiting for them to attack, even though out of character I knew they had retreated back to their city. Were we able to trust everybody to not act on out of character knowledge, we wouldn't need rules against metagaming.