I agree with you, Silvers are not the problem...just the ones that have no idea what they're doing or are so excited with their new status that they just want to make sure they board before somebody...anybody...

Seriously, I make sure to get my wife to Silver every year, just for the few times she flies without me. Regardless of the hassle, she still likes boarding before at least half the plane (admittedly, being in SEA and not hub-captive helps). But more importantly, she loves all the other little things that go along with it: the elite security line here, elite check-in, 2 free bags...and getting them back before most, the mileage bonus, just to name a few.

So to the OP: if the question is, is it worth it?...the answer from here is there's no question about it.