I need a software built that can scrape thousands of web pages from [url removed, login to view] and www.myapartmentmap.com. Proxies will be required and the program must be very fast as there is a large amount of data. Once the data is scraped and put into Excel format, the data must be synthesized (averaged out, compared, and sorted) within Excel to produce comparisons.
Done web scrapping projects earlier reliably. If you prefer I can do it using 'shell script' that may be run in any unix/linux systems, which would be very faster when compared to python for web scrapping.