When you get a new passport from the US, you get the old one back with a hole punched in it.

Whether a country which issued a visa into the old passport will accept it if you show it along with the new passport is a question that you'd want to direct to the embassy or consulate of that country.