When sitting in the window seat, I don't have an issue if the aisle person takes the middle space for the reasons mentioned above, although if their bag is so large that it takes up the entire width (which is already wider than the space directly in front of the window seat), I don't feel bad at all if my foot happens to touch their bag.