If you spend 20 stays with them and are only "close to diamond" then I feel you will be totally wasting your stays with them. You don't stay with them enough to blow to stays you could be having with the other properties with all the benefits to reach a status that you probably won't ever use.
I love being diamond, I never even consider getting status elsewhere, because that's another x amount of stays I wouldn't be at a hilton property for, and to me it's not worth it.