Arrival: From East - Side A. Just make sure you choose a nice clear, non-hazy day.
Arrival: From West - no view of the harbour on either side.
Departure: Towards East - Side K. Just make sure you choose a nice clear, non-hazy day.
Departure: Towards West - no view of the harbour on either side.
As you can't control the landing direction, or the weather, just choose A for arrival and K for departure - that way you'll have some kind of chance of seeing Hong Kong island. But please don't be too disappointed if you don't get the view you want. I live in Hong Kong and flew in and out of the old Kai Tak airport multiple times and never once were the take-offs or landings over land... always over the sea.