two Complaints i have:
1) for some reason you're storing the files as stereo? instead of mono?
2) you really should apply volume compression to the podcast so then the volume levels are consistent - so its easier to listen to
The Kill la Kill clip is in stereo and sound significantly worse in mono. Audio compression is smart enough to not waste any data on the rest of the tracks so it makes no difference.
I did run it through the audacity compressor filter with the default settings. I was wary of cranking it up too high and having it sound weird.