Agreed, I also wouldn't blame someone in the situation if one of my family died.
Lets add another level to this dilemma.
Lets say the trolley has a load of criminals, but also has an equal amount of police officers keeping eye on them (for the sake of those who say "fuk the polic" the police officers are 100% innocent)
Now what is your choice?
You are still saving more than 1 police officer over 1 worker, plus criminals have the chance to rehabilitate, which is an argument for another day. I honestly cannot comprehend how anyone would think allowing the trolley to crash isn't their fault.
Also if you are looking for more of this stuff, BBC's Horizon done a large portion of this kind of stuff on the episode "Are You Good or Evil?". I think it's that one anyway, but It was interesting