Is the color named after the fruit or vise versa?
It's named after the fruit.
Before oranges were a thing in Angland, the color orange was called geoluhread (yellow-red). It's also why a person with orange hair is called a redhead, instead of the more proper term, ginger.