Another advantage of aisle is if you have a tight connection you can jump up earlier and be ready in line in the aisle to get off, whereas if you have a window and the people in the middle/aisle seat are slow to get mobilized (e.g., elderly, half awake, inconsiderate, etc.) they may take a long time to get going -- just enough of a delay to miss a connection!
Also, if you're really sick of sitting in the window seat on a long flight and want to get up as soon as the plane stops, you can't without hunching over because everyone is in the aisles blocking them so you can't get up right away.