FlyerTalk Forums - View Single Post - ITA software scrape
View Single Post
Old Dec 7, 2018, 8:22 am
  #3  
Jan@BRU
 
Join Date: Sep 2004
Programs: LH HON, AF Plat, BA Gold, SPG Plat, HHo Gold
Posts: 155
Zorak,
No -- that's what I mean. From what I understand, the tools you mention assist you in purchasing specific search results, which indeed is a big help.

Scraping refers to automating requests sent to a website and harvesting the results.
Take for example the recently introduced limitation on ITA to limit the jointly queried departure points to cities in a single country. If you want to do a regional query of flights from all departure points in neighboring countries, you need to several requests.
Scraping would run a script, send out a request, wait for the results to display and than store the results before moving on the next request automatically etc.
It's obvious that google discourages that kind of data harvesting and has put in place a few barriers to do it.... I was wondering whether somebody has managed to successfully scrape ITA nonetheless.

Thanks

Jan
Jan@BRU is offline