The answer to this somehow depends on which places you have been before.
One place that is getting a lot of attention is 'Sushi Oyama' in DongHu Lu.
SmartShanghai article
It is very small (14 seats) and the menu changes nightly,fresh and very good Japanese Food in a nice atmosphere.