Sometimes unexpected things show up and you should embrace them rather then removing them.
Well, you never know if this bug would cause problems in the game's development. Even if other bugs stayed, perhaps Mojang didn't want cart-pushing to stay.
pretty sure most redstone things are bugs
Depends. if it's one of those water + torch contraptions, then it's a bug.