I have this same exact problem on my windows surface, the mouse just keeps drifting after i stop moving it. I use a bluetooth mouse and think that is the problem, I'll try a wired one and post back here.
I just tried full screen mode and the mouse works fine.