Buffets work well for us as we have a couple small kids.. but we supervise and make sure we handle the food.

Generally, buffets have server spoons and tongs.. properly used doesn't cause a problem.

Its the food that can be handled with the fingers I agree must be eliminated. Often if food is evidently handled by hand we avoid at buffets. Communal bowls of nuts I avoid as well, unless its served right onto our table.. and at that point within our party we spoon up seperate servings.