It is a demand of resources when going back to the game. Because it was somewhat inactive, those resources are not needed and go elsewhere. When you come back the computer has to clear them out and give it back to the game. You can not avoid it. It is how computers are