There are night buses that go from HKG to the city with different routes, although service might only come once an hour or even less.
Other than that I doubt that there would be a lot to do in HKG as a lot of shops, barring the convenience stores, would be closed in this hour.