You're a perm res in the US? That means you can stay out of the US six months (less one day) at a time. So long as you're inside that time-frame you'll be good. CBP might ask about it, but you can just tell them that it never arrived and you didn't need it for the trip.