Whilst it is a complex issue, it comes down to the consumer wanting cheaper and cheaper air fares! Ultimately, if airlines continue to increase seating density in Y, and travellers continue to pay for said seats then we only have ourselves to blame.
That being said, I have not flown longhaul Y since 2009 and never care to experience this again. I guess you pay for the comfort you want to receive.