How about Annapolis? It is only about 45 minutes from DC. I was there on a day trip about two weeks ago and the downtown area is quite nice. Lots of pubs/restaurants, upscale shopping, old historic buildings, waterfront, USNA, etc. I am sure there must be a ton of B and B's around, but saw a couple of hotels in historic buildings, as well.