As long as you have concrete evidence (in form of passport stamp for other country) that you indeed left US within reasonable time then yes just remove stub from passport.

If you don't have such evidence then it may be very risky move.