Don't know about other countries, but banks in Hong Kong have always offer USD saving accounts. I am talking about at least since the 70's. For example, the saving "booklet" for HKD from HSBC are red in color, while USD ones are green.

So, it makes sense for HSBC or other banks in Hong Kong to provide ATMs for those customers who have USD-based saving accounts.