I never had any audio problems. And I never used anything but the XFCE version, so I wouldn't know about the others. And the package manager thing is just preference.
I fail to see how any of this makes it terrible.
Besides, if you don't like any of the main ones, install the minimal net edition. Then do it yourself.