As a 6'3" and 250+ lb flyer, I couldn't agree with you more. I also have given up on the Exit Row because it's pretty much ALWAYS a full row of guys as big or bigger than me. As much as I need the legroom, the shoulder squash is just not worth it.
In any other row I have a much better chance of being seated next to the small, nice-smelling woman instead. Unless, of course, I'm on the same flight as the OP...in wihch case we're sure to end up seated together. ;-)