Note also that taxis are HK$ cash only, so if you plan to use those to get around then you will need cash. ATMs are everywhere.
There are machines at the airport where you can buy an Octopus card using a credit card, but after that any top-ups need to be cash.