Thanks. The Chau Doc part might be where I went wrong, since it's not on the list of approved ports of entry for the e-visa. (Song Tien is.)

The Vietnam consulate in NYC allows online applications for a visa, with the visa sent back by mail. I need to research further, but after a quick read, it's not clear if this is considered an E-visa or a regular visa.