It applies to other countries as well.
Apparently it was part of a negotiation where China gave a visa-free access to China in exchange for free access to Japan for HK citizens.
In the case of Brunei, it was part of an oil purchase deal. And Singapore it is because of the Chinese roots.