I used to take speech class. Not like, speech therapy or anything, but like actual speeches and stuff. Some things that might help are, when facing away from your speech, don't stare directly at anything, just stare into distance for as long as how much of the speech you know first-hand. It always worked for me.