What if we simply make it so within a time period of the player getting killed, if he leaves, it says that?
if i remember correctly, there's a mod that makes you leave the server and display that exact message if you say /ragequit