Really depends on your price range ... the depachika section at Mitsukoshi, Takashimaya, Daimaru, etc have really good produce and grocery items. Adn Precce at the midtown complex in Roppongi also is a quite good supermarket, in my opinion.
But these are more high-end and Precce could be more geared to the expats living in Roppongi ....