I'd recommend Vinnie's Pizza on Amsterdam and 73rd for the best slice in the area.

The Popover Cafe on Amsterdam and 86th is great for breakfast but gets really crowded on weekends.

There's also an Emack and Bolio's ice cream at Amsterdam and 78th. They have really decadent ice cream flavors and were the ones that invented cookies and cream.

I've never liked Ollie's food at all but perhaps that's because I'm one of those east side people that dhammer mentioned