I say go. The culture is pretty cool, and for those who think I'm talking about anime stuff, do you think Japan views American culture all based around Sponge Bob Square Pants? No? Then why do you think their culture is all based around anime?
I've heard second hand the people are really nice, and it should be really interesting for a trip to go on.