It all depends on the opulence of the buffet and if you get a bill or not.

For breakfast, in an RC or FS, where they come and remove steadily dirty dishes and so on, I leave a minimum of $3.-. At a simple place $1.- is sufficient.

For Lunch or Dinner, depending on service (removing of empty plates, refilling of glasses, etc. I leave $ 5.-

My two cents