I don't think it's annoying. It was funny at first, that part I will agree with. But it didn't suddenly become irritating and stupid because it became popular, it just got a little old and a bit less funny.
What irritates me much more than the harlem shake is that as soon as something becomes viral (like Gangam style last year) there's always a group of people that grow as time goes on that scoff at whatever is popular, whether it deserves the criticism or not. At first it's mainstream to like the fad and then it seems to be mainstream to hate the fad and make a huge deal out of how terrible the fad is.
