I love afternoon tea! Lovejoy's does a casual (rather than fancy one) in SF Noe Valley that's a great afternoon out with the girls. L'Espalier in Boston also has a special afternoon tea that I think might be seasonal that is fancy and wonderful. Otherwise, I think it's typically an offering of fancy hotels. The Brits really had the right idea.