The National Gallery and National Portrait Gallery will be on your doorstep.
A river boat down to Greenwich will get you on the river and then a wander around the National Maritime Musum/ Greenwich Park*/ Old Royal Naval College and then the market are a nice day out too.
* a chunk of the park will be cordoned off as the Olympic Equestrian Events are being held there but there will still be plenty to see.