Take prisoner.
He's more valuable to you alive rather than dead, and following him could lead you to being caught by an imp ambush.
However, if you did follow him, you could find the locations of an imp camp without trying to beat the crap out of him to get the info.