I am a small to medium frame person, and I have always thought that physically very large and imposing people (men, especially) tend to be tested less. Even though we live in a society where conflict rarely results in physical escalation, our cave-man roots have programmed us to be scared of more physically imposing people. A trait that exists to this day. Well, that's my opinion!