Yeah that's kind of the point of being a bandit? I kept informing people I'd only murder them if they fought back. Infact I always gave the oppurtunity to run away, to tell people that there is bandits about, travel in groups. I'd never steal guns.
Personally I dont see an issue. I was smart, i'd never pick on groups. If people were smarter and travelled in groups there wouldnt be an issue.
By the way, I stopped being a bandit ages ago, When my bandit character died. That and I realized the ground of it was kind of shaky.
I'm just another survivor like alot of people, now.