Then it should be "I pledge allegiance to the United States of America" or something that doesn't make us sound like we're worshiping the flag.
"I pledge allegiance to the flag,
of the United States of America..."
Point stated? The flag represents our country, we have the flag to honor those that died for our freedom. That's why, at funerals for(I think) service members(army, ect...), they have a flag on the coffin.