The mute player is a gimmick. Might as well make space for new blood by either kicking or banning.
If they are spammer/loud starfish, chances are they are going to keep doing the same stuff over after you un-mute them. A good kick usually sends a message. A temporary ban can also send a message. Super long ban can also work. If that fails a permanent one purges the problem for good too.