FlyerTalk Forums - View Single Post - AmEx Financial Review - BE CAREFUL OF SURVEYS
Old May 31, 2009 | 10:03 am
  #34  
chriswufgator
 
Join Date: Dec 2006
Location: Jacksonville, Florida
Programs: USAir Gold, Delta Slvr, Amex Plat, Hertz #1 Gold
Posts: 412
Originally Posted by dgwright99
There is no such thing as a "valid"s correlation in this sense. Either there is a correlation, or there is not. If you mean "causality" then causality is irrelevant in a situation like this. Having had a credit card for 5 years rather than 10 does not cause me to be any more likely to deafult - but it is correlated with a higher default rate.

Your "ban red cars" is a very poor analogy, because here we are talking about a private entity making a business decision, and not a state entity imposing the force of law.

To suggest that a lender not be permitted to use any statistically significant correlation they choose in the course of evaluating a borrower is akin to suggesting that you or I should be regulated in the combination of factors we entered into a stock screener when researching investment opportunities.



Coincidences are no less "real" correlations than combinations that are linked by causality. Correlation is a mathematical attribute,
You are overlooking the real issue.

Many statistical correlations are in reality totally meaningless, being the product of nothing more than coincidence, or being brought about by some third factor of which the statistician is unaware. This is a "false positive".

Any system that lacks the capacity to determine meaningful from meaningless correlations is completely non-functional for any purpose.

Again, if Amex added Office Depot to its nexus based on a spike in trailing cardholder defaults by OD customers, when it was caused by OD holding a closeout sale on a "DIY Foreclosure Defense Kit" for let's say 10 days, then the system is a complete failure, because it takes action that leads to real costs based on incomplete data. The only real legitimacy of that data-point was the 10 days during which that merchant's sale was attracting less creditworthy borrowers. By the time the system responds, it's already too late. This is the problem with trailing data.

The bottom line is, Amex has nowhere near enough data points to create an accurate predictive behavior model. They will *think* it's accurate based on the false positives the system finds, only because they lack sufficient data points to differentiate between meaningless and meaningful correlations.

If you mitigate risk based on meaningful correlations, then you'll achieve a real result. But if you start axing customers based on meaningless or coincidental correlations, then you're costing yourself (a lot of ) money.
chriswufgator is offline