I returned from the Kalos region yesterday and played Animal Crossing New Leaf again. To my surprise, only one of my villagers had moved out and I didn't even like that one, so that's pretty cool I guess.
Sadly, I had to leave 1 day later to the Pi'illo Island region.