I'd second the Skamania Lodge recommendation, they have a Sunday Champagne brunch. The drive will be worth it, too. You might want to go across the Columbia at Portland and up the Washington side on the way out, then cross the Columbia at Cascade Locks on the way back and take the Oregon side back to Portland.
http://www.skamania.com/