I have 2 pet peeves:
1) This is the BIGGEST one of the 2: when I feel rushed by the server. Typically when I go out to eat on weekends or on vacations, I like to take my time and enjoy cocktails and maybe an appetizer or two before even thinking about what I want to order for the main course. I always try to be up front about it with the servers that I am not in a hurry. It usually is not a problem but every now and then, I will get an overly-eager one who insists on rushing me.
2) When drinks are not refilled in a timely manner. I have had occasions where drinks were finished and a half hour went by and no offers of re-fills were given. This was at a time where the restaurant and server were not busy.