You word this as though everyone counterprotesting saw violence as an appropriate response to the protest. Most of the protestors (on both sides) were peaceful and you shouldn't expect a violent response if you're not being violent yourself.
as far as i know the only violent thing counter protesters did was tear down the statue without authorities consent. i personally expect violence when a large amount of people physically come together with strong conflicting ideas in this fashion. i certainly wasn't surprised to see this outcome. its human nature to fight for what you feel is right. were clearly in a time where it doesnt matter what you say. one side will see you as right, and the other side will see you as wrong. you cant change that kind of mind. especially on the spot. neither one of these sides would have come to the conclusion "it was wrong for us to come out here today".
with that in mind, i think things would have gone much smoother had counter protesters taken baby steps. let the national socialists make their point, let them leave, and then either
a: make your point by counter protesting
or
b: make your point by proceeding to remove the statue like it doesnt matter. becuase it doesnt