It's distinctive, which linguistically is what you want for such an important word.
It would be very hard to hear "yes" instead of "no" because of how phonetically different they are, and yet they are such small words.
Take Spanish for example, the word "sí" with its accent means "yes", but without the accent it means "if". Think about the kind of trouble that could cause.