1) Depends where you look. When I started, I got lessons and it was something like $20 per lesson.
2) IMO, the best sounding guitars are the cheapest just because of their raw sound. Although, for starting, I recommend buying a used guitar for something between $70 and $110. If later you want to buy a new guitar for a higher quality sound, I'd recommend looking at Ibanez guitars. They can be rather pricey, between $300 and $700, but they're still the loveiest guitars I've ever played.
*Note: It's better to learn acoustic guitar before electric. Because of the thick strings on the acoustic, it makes things a lot easier when pressing down on the strings of an electric guitar.
3) Amps can range between $30 and $600. The first amp I ever bought was $25, but it was also just a measly 10 watt amp. But if you're starting, there's nothing wrong with that. It all really depends on what stores you go to. Obviously though, the lowest quality amps are going to be the cheapest.