My only concern is how the left part of the controller would work--you'd have to plug it into the audio jack. I honestly don't know just how much data can be sent through it, I know you can control volume with certain earbuds but that's about it.
Maybe the other way around, A and B could be volume up and down, and the D-Pad and stuff would be on the other side? Because A and B are only two controls. Two functions, volume up and volume down.