My update on renting a car with TTP card:
I picked up from Orix at Kanazawa Station, and the staff just took my passport and didn't even look for or ask about an entry stamp. All they wanted to see was my passport and IDP. Everything else went smoothly after that.