FlyerTalk Forums - View Single Post - My Flyertalker Yearly Spreadsheet
View Single Post
Old Sep 21, 2015 | 4:21 pm
  #26  
nsx
Moderator: Southwest Airlines, Capital One
Community Builder
Conversation Starter
All eyes on you!
25 Years on Site
 
Join Date: Sep 1999
Location: California
Programs: WN A-list preferred, United Club Lietime (sic) Member
Posts: 22,856
Originally Posted by AndyPok1
So... A) Anyone have any idea why none of these formulas work and all are slightly off base? The source data is from Flying Fish and that gets the right distance, so it's something in the calculation.
That looks like a Haversine formula, which is very close but not an exact match for the Earth's actual shape. I don't think you can get much more accurate in an Excel formula.
nsx is offline