Window is in the way but besides that
I just leave it on my desk where the sun shines
Yeah, that's likely your problem. Plastic doesn't biodegrade (for the most part), but it does photodegrade so it will break down in heat/light.
If you leave a cheap water bottle in the sunlight it will get warm and start to break down, leaking the components of the plastic into the water.
You should move your water into a shaded location. A cupboard/pantry/fridge would be best.