Not necessarily lose. Call HH and ask to add those points for stays when you had a car rental with one of their partners. Most likely, you'll be required to fax them copies of car rental agreements though.