I was in Whistler last month and can echo this. It snowed every day while I was there, but was told by folks that live there that it hadn't been snowing much until I got there. And yes, if you're not skiing, there's not much else to do beyond walking around the village which is easily done in an hour or so.

But if skiing is what you want to do, there's no shortage of slopes to tackle, especially if you're an intermediate or above skier. I had never skied before until my trip, and had a great time there. ^