FlyerTalk Forums - View Single Post - Calculator for SQM, Aeroplan miles, & SQD
Old Jun 15, 2022 | 11:49 am
  #527  
Adam Smith
Moderator, Air Canada; FlyerTalk Evangelist
 
Join Date: Feb 2015
Location: YYC
Programs: AC SE MM, FB Plat, WS Plat, BA Silver, Marriott Plat, Hilton Gold, Accor Gold
Posts: 18,944
Originally Posted by canadiancow
Okay that was quick. I'm just checking both old and new distances to be within 3% of the Haversine, and here's the output:


Code:
BKK-HKG old Aeroplan distance (1172) more than 0.03 off of Haversine distance (1049)
DEN-DFW new Aeroplan distance (960) more than 0.03 off of Haversine distance (641)
DEN-SNA old Aeroplan distance (1311) more than 0.03 off of Haversine distance (844)
DXB-VIE old Aeroplan distance (1838) more than 0.03 off of Haversine distance (2624)
FLR-LHR old Aeroplan distance (5354) more than 0.03 off of Haversine distance (756)
FLR-SFO old Aeroplan distance (5685) more than 0.03 off of Haversine distance (6105)
FRA-VIE old Aeroplan distance (373) more than 0.03 off of Haversine distance (385)
ICN-PEK old Aeroplan distance (588) more than 0.03 off of Haversine distance (560)
ICN-ZRH old Aeroplan distance (1280) more than 0.03 off of Haversine distance (5433)
ISL-VIE old Aeroplan distance (554) more than 0.03 off of Haversine distance (777)
KUL-PEK old Aeroplan distance (1901) more than 0.03 off of Haversine distance (2742)
LAX-RAR old Aeroplan distance (4982) more than 0.03 off of Haversine distance (4683)
LHR-VIE old Aeroplan distance (552) more than 0.03 off of Haversine distance (792)
MUC-TXL old Aeroplan distance (312) more than 0.03 off of Haversine distance (298)
PEK-ULN old Aeroplan distance (363) more than 0.03 off of Haversine distance (724)
SLC-YYZ new Aeroplan distance (1902) more than 0.03 off of Haversine distance (1656)
TPA-YYZ old Aeroplan distance (1057) more than 0.03 off of Haversine distance (1096)
VIE-ZAG old Aeroplan distance (171) more than 0.03 off of Haversine distance (165)
YEG-YOW new Aeroplan distance (1669) more than 0.03 off of Haversine distance (1770)
YEG-YYC old Aeroplan distance (158) more than 0.03 off of Haversine distance (152)

Some of these are definitely issues, but I can also tweak the threshold.
That 3% is a decent flag. Some of those might have been transposed in the old spreadsheet (the one before I took it over). I definitely found a few that were massively off, but when I realized someone had just been off by a row or column, it made sense, so I shifted them.

I should have caught the YEG-YOW one, because we had the old distance. I'm guessing that was just a typo from [MENTION=194158]YZF_Elite[/MENTION], who's the one who reported it, and that it should have been 1769. Then again, it could have been a brain fart, since YEG-YYZ is 1669. Perhaps he could clarify for us.

PEK-ULN is clearly someone who flew a 50% fare.

YYZ-SLC is my bad. I was sent both the base and total SQM, and I just looked at the wrong line.
Adam Smith is offline