The oldest part of the CBD is around Circular Quay and the Rocks, the Tank Stream that runs pretty much straight down Pitt St was the original water source. But you are correct, that if you want the postcard view of Sydney then the southern end of the CBD is not where you will get it.