I second the Borough Market (although I do understand lala's feeling of potentially being trampled...somehow the yummy chorizo sandwich makes up for that!).

I am very partial to Portland's Farmer's Market, particularly the Saturday market at Portland State -- great produce, cheese, meats, oysters, fresh fish & food demonstrations!