You can charge your airport express train tickets and eat at better restaurants. But you need cash fo everything else - either in actual cash, or as credit on an Octopus card.
Only a handful of taxis - and I mean literally a handful - take Octopus or credit cards. The vast majority of taxis are cash only.