All the reasons you describe is why, despite the fact I love LCY as arrival airport, I try to avoid it as departure port.
It's great if you live or work nearby and can time your arrival, but I like to arrive at the airport with plenty of time in advance, and plan my days accordingly. Also, if you are delayed, it's not a great place to be.