but then gravity cant pull you down 
It's still pulling you down, onto the thing you climbed onto.
you can on the moon
The moon has gravity too. Less, but it's still there.
Why do you think solar system and everything holds together? You can't escape gravity, unless you leave the galaxy or something.
.... hmmmm....