Head to Tribecha - Triangle Below Ochanomizu (Don't ask anyone where Tribecha is. I just made that up).

Basically, from Ochanomizu walk south down Meidai Dori as far as the major intersection, then turn left and walk as far as Ogawamachi station, then head back to Ochanomizu. That triangle is rich with shops selling new and used instruments.