I've had this happen once. They're actually Russian spy chickens! You can't simply kill it, or they'll bomb you with egg bombs. You must tickle it and make it run away. If it gives you a apple, NOT a crab apple, you've done it right. A crab apple means they're on to you.