I wouldn't be too eager to give up a small school population.
It means fewer students to each teacher so you get more focussed lessons and classes that are closer to a one-to-one education.
Also you can still socialise with old friends after school and make new ones with different views and opinions.
And as harsh as it sounds, sometimes friends get in the way andc an be a real distraction to your education. I had a lot of fun with my close friends in high school, but sometimes that meant not working or concentrating, and my grades did suffer.
Ultimately it doesn't overly matter. As long as you work hard and achieve at both you'll get where you want to.