I've had this happen with CBP a few times. Usually off flights coming from places with high levels of cash transportation on person or looking to attack asylum seekers. I've actually had it happen more in Canada with CBSA. I doubt it was ICE. They often have you show just the front of your passport and let you go if you are a US citizen.