If i join the Imperials will i get kicked out of towns?
You may not get very much kindness, but you won't be kicked out.
Also, keep in mind that some people in towns occupied by a certain faction don't appreciate the occupation of said faction, and wish for the opponent to come and take over.