This is just nitpicking; when it is used in an expression as such it is a learned habit and should be ignored.
I still have to restrain myself from using "for the love of god" and "for god's sake"
I'm just sick that it gets used so often (oh my god, god dammit, god, god, god, god you're an idiot, bla bla bla).