I want to purchase 2 sets of scraping engines:
A) The first set will scrape bid/auction data from 1) eBay and 2) another auction site
B) The second set will scrape hotel/rate information for ~2,000 hotels on 3) [url removed, login to view] and 4) Expedia
The scraping for auctions will be done approximately once a week.
The scraping for hotels would be ad hoc. I would send a sheet with 100 names on it, for example, and look to have them run through the engine.
I would prefer that you run the scraping engine, and it is hosted on your servers, so that I just receive the output.
I want continued support with this project, as I am concerned that the sites may change periodically.
Please let me know how much you would charge in support fees on a monthly basis
I am not looking to scrape a massive amount of data from any of these sites. Nevertheless, I am concerned that they may limit requests from your IP. Please let me know if you think this is a concern, and your plans to address it.
***Which Items to Scrape***
On Ebay and the other auction site, I am only interested in collecting new auctions.
I am only interested in approximately 2,000 hotels. I will send requests for these to be scraped periodically.
I expect that there will be an upfront fee, and then a monthly maintenance fee. The maintenance fee would be to ensure that the scrapers continue to work if the site formats are changed, or if they look to limit access from an IP. Please let me know what both of these fees would be.
I would prefer someone that I can speak with. Please let me know if you have a Skype account that we could use to discuss the project initially, and for support in the future.