Taipei downtown is not huge, so getting around by taxis is quite practical. Night markets don't really stay open all night, so you'll want to be efficient about getting to one. One option: airport bus to Taipei (train) Station, taxi to Shida night market, eat, buy; then taxi to a hotel such as Howard Plaza, where you can get a direct airport bus in the morning. Have addresses written out in Chinese for the taxi drivers.