Sounds like you were not only expecting and aisle seat with the seat next to you blocked, but also the window seat too. You get one or the other, not both.

If I were stuck in a window or middle seat, and I noticed a untaken aisle seat somewhere, I would likely try to snag it myself as I too hate being boxed in.

At any rate, stick to your aisle seat and you won't have a problem.