We paid off our mortgage and car loan 5 years or so ago. I always had a credit score of close to 850.....I noticed a drop in my score of 10 or 15 points. It didn't like me no longer having a long-term loan that I paid every month on. 5 years later, no debt, c.c. paid off monthly.... my score has been a consistent 839.....never getting back up to the high 840's when I had a mortgage.
Being debt free is totally worth the loss of 10 points on my credit score.