Restaurants want customers out of there as soon as possible to make room for the next one. Sitting at a table for 20 minutes, taking up space while not ordering is just bad for business. I blame restaurant managers more than waiters for this.