If a weak man was hitting a strong man, would you still say he should "just walk away"?

Most people would still say the small guy had it coming for hitting a person who is stronger like an imbecile. So it seems to me the "never hit a girl" thing is more about women being able to strike men with impunity than it is about strength.