We are doing some pricing research and need to go through a few flight aggregator websites across different countries to scrap the ancillary add-on products (mainly insurance) for a different combination of departing country, destination country, trip duration, round vs one-way, flight fares.
0. Flight Cost
Some of the insurance is dependent on flight cost, you need to pick two-four random flight out of the list shown on the flight aggregator
50th percentile -median price*
75th percentile *
*sort all prices from lowest to highest and pick the 7th page (out of 10 pages) for 75th percentile or 5th page (out of 10 pages) for the median price
If the insurance price does not change after you scrap the first two insurance price (25th percentile, and 50th percentile) then do not go and scrap the 3rd and 4th prices for the rest of the site for that specific country
Some domains are in a foreign language like germans or spanish, please use google translate to navigate the sites
1. Type of products
insurance related like, travel insurance, cancellation insurance, baggage insurance, flexible ticket, Airhelp plus flight delay compensation
do not worry about seat selection, premium vs economy add on, equipment, hotel add on, car hire add on
2. Insurance Price
You will need to record the insurance prices on google sheet and a screenshot of each quote (we need to see these on the screenshot departure and return date, country and airport of departure and destination, flight cost before any insurance add-on) onto a google document
Please save the screenshot sequentially based on the order of the records on google sheet
Refer to screenshots
3. Policy Wording
You will need to download policy insurance wording for each of the product and save into each respective folder on google drive
These are usually located on the page where you're shown the product, for instance, it is under the "view insurance details and disclosures" for [login to view URL]
Please save in the following format Website (expedia) - Domain Country (US) - Product Type (Travel Insurance) - State (Nevada if applicable) - Original file name (PITOE2017)
Expedia - US - Travel Insurance - Nevada - PITOE2017
Please save the documents into the google drive
Note if there is no insurance offering for any particular site (+domain), please continue with a few more quotes, as some insurers may not offer any products for flight cost below or over certain flight costs, otherwise, skip to the next country/domain/site. Note for some sites, you may not find any insurance for certain countries.
This is an ongoing project, we will award more works for those who are efficient!
Refer to google links below for more information
[login to view URL]
[login to view URL]
I expect this to be completed in less than 30 hours using brute force method and less if you build a python scrapper, and preferably by end of this week.
The fee is negotiable.
Hi, My name is Janis and I have been here in freelancer since 2014. One of the preferred freelancer because of the good standing and have good feedback from previous employers. I was asked by the freelancer staff to bi Daha Fazla
Bu iş için 16 freelancer ortalamada $237 teklif veriyor
Hello! I read through the job advert and I am absolutely sure that I can do it very well and meet your deadline. Award me the project and you can be assured of the best.
I have worked on many papers in report writing, research.I have read and understood your requirement and I know you will never regret, thank you.
Hi, i've got experience in data gathering (including bruteforce scraping) and analytics for data-based startups. Contact me if you're interested. Relevant Skills and Experience Python, Web-scraping