US doesn't stamp passports on departure.
Use your US passport in HKG, no visa required. I wouldn't walk with the two passports to border agents, put away your TW passport somewhere.
Use your TW passport when entering/exiting Taiwan.
Always use your US passport when entering the US, no need to show your TW passport there. I've never been asked for my second passport.