I don't eat at buffets for three reasons. First of all, I usually do better cost wise by ordering off the menu. I don't eat enough to make a buffet a cost effective option. Second, I find that many buffets (at least, around here) may have many different dishes, but they all taste suspiciously the same. And last, I have seen too many people use their hands at a buffet to make me decide that I'd rather skip that visual.
(Yes, I know it happens back in the kitchen as well. But I haven't seen it back there!)