I'd think that Riddler would be physically weaker.
Stalin. Riddler was actually in the army so he would be more of a pain to deal with