Last edit by: Ocn Vw 1K
UA Insider's reply in posts 247 and 254 of this thread:
Hi everyone,
We recognize the importance and value to you of accessible and transparent information about United flights. It’s a meaningful part of your travel planning, and we are committed to providing useful information that is both accurate and preserves the integrity of United’s data and systems.
While we are committed to data transparency, Expert Flyer has been accessing united.com in an unauthorized fashion to retrieve UA availability. In addition, these activities have consumed significant united.com bandwidth that could otherwise be used by regular consumers. As a result, we had to take this action to protect the security and integrity of United’s systems.
Thank you for your understanding as to why we had to take this action. We continue to look at ways in which we can provide you with timely and useful information (some of which you will see in new releases of our own digital channels) as well as with partners that have authorized access to our data.
Aaron Goldberg
Sr. Manager - Customer Experience Planning
United Airlines
We recognize the importance and value to you of accessible and transparent information about United flights. It’s a meaningful part of your travel planning, and we are committed to providing useful information that is both accurate and preserves the integrity of United’s data and systems.
While we are committed to data transparency, Expert Flyer has been accessing united.com in an unauthorized fashion to retrieve UA availability. In addition, these activities have consumed significant united.com bandwidth that could otherwise be used by regular consumers. As a result, we had to take this action to protect the security and integrity of United’s systems.
Thank you for your understanding as to why we had to take this action. We continue to look at ways in which we can provide you with timely and useful information (some of which you will see in new releases of our own digital channels) as well as with partners that have authorized access to our data.
Aaron Goldberg
Sr. Manager - Customer Experience Planning
United Airlines
UA Blocking Expert Flyer and KVS Access to R and Elite Award Searches.
#811
Join Date: Jan 2010
Programs: UA, AS
Posts: 2,393
I'd be tempted to call an agent and have them check every single day in a 3 month period. If they think this is better for them maybe they'll rethink it if it ends up costing them money? They need to save $2B.
#812
Suspended
Join Date: May 2011
Location: SFO
Programs: UA 1K
Posts: 1,961
Unfortunately, my time is worth a lot more than their call center agent's time.
#813
FlyerTalk Evangelist
Join Date: Mar 2004
Location: SGF
Programs: AS, AA, UA, AGR S (former 75K, GLD, 1K, and S+, now an elite peon)
Posts: 23,195
#816
Suspended
Join Date: Jan 2001
Location: ORD / DUB / LHR
Programs: UA 1K MM; BA Silver; Marriott Plat
Posts: 8,243
Are you serious? The issue is that they don't want us to have the data at all. Whether their website is marginally better or worse than someone else's website doesn't change the fact that they could easily give this data away for free (or even sell it for a profit), and they don't because they don't want to make it too easy for people to find and know what the inventory is, and they don't want some people (who are more sophisticated and more willing to use tools) to have an 'advantage' in using their upgrades or miles. It's got nothing to do with enforcing the terms of use, because they could easily change the terms of use or make the data available in a manner consistent with the terms of use.
We can argue all day long about whether pulling bulk data from a company's website using screen scraping without any form of commercial agreement is acceptable (it's not, IMO) or even whether UA would be willing to enter into such an agreement, but arguing that they don't want you to have the data in the first place is farcical.
These websites wouldn't have been able to provide this functionality if UA didn't provide the data on their website in the first place
#817
FlyerTalk Evangelist
Join Date: Sep 2002
Location: Between AUS, EWR, and YTO In a little twisty maze of airline seats, all alike.. but I wanna go home with the armadillo
Programs: CO, NW, & UA forum moderator emeritus
Posts: 35,432
Let me continue that line of thought by pointing out that these sites would have to make the same queries that anyone else would have to. They just do so in an automated fashion. So, in the example above of finding SFO-SYD flights in a 3 month period with 'R' space, the screen-scraper would have to check fr you the same way you would over 90 days and presumably 90 queries. The number of queries required would furthermore be multiplied based on the frequency of the requests. Now, that's not terribly difficult to do, but it does place a load on the reservation system. The sites were selling that as a service and collecting cash. But they weren't paying for the underlying infrastructure needed to support the extent of their requests. When you have one or two people doing this it's not a problem and nobody notices. When you have thousands, it is a problem and people do notice.
#818
Suspended
Join Date: Jan 2001
Location: ORD / DUB / LHR
Programs: UA 1K MM; BA Silver; Marriott Plat
Posts: 8,243
Let me continue that line of thought by pointing out that these sites would have to make the same queries that anyone else would have to. They just do so in an automated fashion. So, in the example above of finding SFO-SYD flights in a 3 month period with 'R' space, the screen-scraper would have to check fr you the same way you would over 90 days and presumably 90 queries. The number of queries required would furthermore be multiplied based on the frequency of the requests. Now, that's not terribly difficult to do, but it does place a load on the reservation system. The sites were selling that as a service and collecting cash. But they weren't paying for the underlying infrastructure needed to support the extent of their requests. When you have one or two people doing this it's not a problem and nobody notices. When you have thousands, it is a problem and people do notice.
#819
Join Date: Oct 2009
Location: Chicago, IL
Programs: UA 1K MM, HHonors Diamond,PC, Marriott Rewards Gold
Posts: 1,118
It comes down to control, UA wants it and loses some of it to EF and KVS Tool. Ego is a powerful element in all of this.
#820
Suspended
Join Date: May 2011
Location: SFO
Programs: UA 1K
Posts: 1,961
Let me continue that line of thought by pointing out that these sites would have to make the same queries that anyone else would have to. They just do so in an automated fashion. So, in the example above of finding SFO-SYD flights in a 3 month period with 'R' space, the screen-scraper would have to check fr you the same way you would over 90 days and presumably 90 queries. The number of queries required would furthermore be multiplied based on the frequency of the requests. Now, that's not terribly difficult to do, but it does place a load on the reservation system. The sites were selling that as a service and collecting cash. But they weren't paying for the underlying infrastructure needed to support the extent of their requests. When you have one or two people doing this it's not a problem and nobody notices. When you have thousands, it is a problem and people do notice.
This is so far from reality that I'm not really sure it's worth a discussion. Factual question - does UA show instrument-supported upgrade inventory (in the forward cabin / both forward cabins if applicable) for all of its flights on its website when you do a search? If so, how can you possibly make the statement "The issue is that they don't want us to have the data at all."
It's not that it's just slightly inconvenient. They put it literally beyond the realm of possibility. It would take hours just to confirm that there's no availability on any of a large range of dates. It would cost me more (in my time) to search for upgrades than to just spend thousands of dollars on first class tickets.
On reflection, they probably aren't deliberately making it impossible. They just don't care about the value to their users.
Last edited by iluv2fly; Mar 28, 2014 at 11:53 am Reason: merge
#821
FlyerTalk Evangelist
Join Date: Jun 2003
Location: DEN
Programs: UA MM Plat; AA MM Gold; HHonors Diamond
Posts: 15,866
I wonder how much of this is due to wanting to withhold the data from the competition.
#822
A FlyerTalk Posting Legend
Join Date: Apr 2004
Location: GVA (Greater Vancouver Area)
Programs: DREAD Gold; UA 1.035MM; Bonvoy Au-197; PCC Elite+; CCC Elite+; MSC C-12; CWC Au-197; WoH Dis
Posts: 52,140
#823
Join Date: Oct 2012
Location: NYC
Programs: AADULtArer
Posts: 5,693
They make it too hard to do, returning only one result at a time, so people can't collect all of the data they want and need.
It's not that it's just slightly inconvenient. They put it literally beyond the realm of possibility. It would take hours just to confirm that there's no availability on any of a large range of dates. It would cost me more (in my time) to search for upgrades than to just spend thousands of dollars on first class tickets.
On reflection, they probably aren't deliberately making it impossible. They just don't care about the value to their users.
It's not that it's just slightly inconvenient. They put it literally beyond the realm of possibility. It would take hours just to confirm that there's no availability on any of a large range of dates. It would cost me more (in my time) to search for upgrades than to just spend thousands of dollars on first class tickets.
On reflection, they probably aren't deliberately making it impossible. They just don't care about the value to their users.
For those searching for upgrade inventory just to fly up front for the experience, life is harder.
#824
Suspended
Join Date: May 2011
Location: SFO
Programs: UA 1K
Posts: 1,961
Have you tried your suggestion? It doesn't actually work. You can check "+/- 3 days" but it still doesn't show you flights or upgrade availability on those dates, just an overview of prices. You still have to search each date and then look at all of the individual flights.
#825
Join Date: Aug 2008
Location: PHL
Programs: UA 1K 1MM, Marriott Gold, IHG Platinum, Raddison Platinum, Avis Presidents Club
Posts: 5,271
Not sure how much its actually a factor, but for every unused GPU, its a potential sale.
Exactly, its ironic that KVS is a subscription service. If it was just a regular program you buy or open source, then it would be alot more difficult for UA to stop this. Other than speed, I don't think there's any way for UA to actually tell if you are using your browser or using an automated browser.
Let me continue that line of thought by pointing out that these sites would have to make the same queries that anyone else would have to. They just do so in an automated fashion. So, in the example above of finding SFO-SYD flights in a 3 month period with 'R' space, the screen-scraper would have to check fr you the same way you would over 90 days and presumably 90 queries. The number of queries required would furthermore be multiplied based on the frequency of the requests. Now, that's not terribly difficult to do, but it does place a load on the reservation system. The sites were selling that as a service and collecting cash. But they weren't paying for the underlying infrastructure needed to support the extent of their requests. When you have one or two people doing this it's not a problem and nobody notices. When you have thousands, it is a problem and people do notice.
Last edited by iluv2fly; Mar 28, 2014 at 11:55 am Reason: merge