As you entered Taiwan on the Taiwanese passport you need to use it to leave Taiwan. If there are any queries about your eligibility to enter Hong Kong then you show your US passport. The US passport is what you use to enter & leave Hong Kong.

On return to the US immigration won't give two hoots that your passport doesn't have any evidence that you left the US - but as you've pointed out you should have left the US on the US passport