Yeah, or you know what would be cool, dual knives. The right hand will stab, the left hand will throw. So if you decide to throw it the knife in the left hand will be gone but the knife in the right hand will still be there for you to only stab.
So if you throw the knife it will be gone but not from your inventory because you will still have the other knife to stab with.