Custom Web Scraper and csv Import Tool

Dear Coders,

We have a csv file containing several thousand tool model numbers. We want you to build a scraper that we can periodically use to scrape the individual URL for each product from 14 retailers and append the csv file with the URL's for each product.

If the product is not available on one of the source sites, then simply skip.

The 14 sites will be fixed but we'll need to be able to omit one or more of the retailer sites from collecting the data if necessary...a simple checkbox option next to the 14 retailers is all we'll require. That is...by default they are all checked and hence all scraped for the product URL however if one or more is unchecked, they will be excluded from the scraping process and hence results.

You'll need to factor in how to prevent the scraper from being blocked.

We've included a csv file with product examples.

Please Note: I understand that we should use separate csv files rather than tabs.

The 14 retailers are listed here:

1) Total Tools - [login to view URL]

2) Just Tools - [login to view URL]

3) Vek Tools - [login to view URL]

4) Get Tools Direct - [login to view URL]

5) Power Tools Specialist - [login to view URL]

6) Bunnings - [login to view URL]

7) Discount Trader - [login to view URL]

8) Tool Mart - [login to view URL]

9) Melbourne Tools - [login to view URL]

10) Trade Tools - [login to view URL]

11) Australian Industrial Supplies - [login to view URL]

12) C L Tool Centre - [login to view URL]

13) Gasweld - [login to view URL]

14) Mitre 10 - [login to view URL]

Next, you'll need to modify a price comparison plugin we have built to allow it to import this csv data into the database. We will provide access to a copy of the site for you to review the code after acceptance of the project.

Any questions, please advise.


Beceriler: Javascript, MySQL, PHP, Yazılım Mimarisi, Web Scraping

Daha fazlasını gör: web based excel import tool, csv import tool, web based calendar import csv, mac web scraper, web scraping tools open source, web scraping tools, web scraper chrome, web scraping service, web scraper tool free download, web scraping automation, import io web scraping, twitter, seo, php, android, software testing, java, mysql, animation, css

İşveren Hakkında:
( 340 değerlendirme ) Diamond Creek, Australia

Proje NO: #17295526



Hi Simon, I can build such a scraper for you. Basically, it will go to those 14 sites and find you the URLs for the tools specified in a CSV file (I've looked through the attached .xlsx file). I'll build in proxy fu Daha Fazla

%selectedBids___i_period_sub_7% gün içinde 300%project_currencyDetails_sign_sub_9% %project_currencyDetails_code_sub_10%
(0 Değerlendirme)

Bu iş için 51 freelancer ortalamada $848 teklif veriyor


Hi, I can do those scrapers at a rate of USD 200 per website. Please let me know if that works for you so I can propose a qualitative solution on how to merge everything along with direct import into your database (omi Daha Fazla

in %bids___i_period_sub_35% gün içinde3333%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(296 Değerlendirme)

Hi, I have experience of working on similar projects, I can help to develop automated script to scrape product from the websites. Please let me know about time when you would be available so we can discuss further. Daha Fazla

in %bids___i_period_sub_35% gün içinde750%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(293 Değerlendirme)

Hi, I am interested in your project related to build a scraper for 14 retailers websites. I have scraped some of them in the past like totaltools, vektools, gettoolsdirect, etc .. Please check my profile portfolio an Daha Fazla

in %bids___i_period_sub_35% gün içinde1500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(272 Değerlendirme)

Hi, my name is Selim. I see the bids, but this is not an easy and straightforward task I am afraid... I read your "Custom Web Scraper and csv Import Tool" project descriptions carefully before bidding. I checked the t Daha Fazla

in %bids___i_period_sub_35% gün içinde1200%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(253 Değerlendirme)

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Daha Fazla

in %bids___i_period_sub_35% gün içinde700%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(84 Değerlendirme)

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator and I'd Daha Fazla

in %bids___i_period_sub_35% gün içinde1490%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(202 Değerlendirme)

100% JOB SUCCESS!!! Hey, I am a full stack developer with great experience and skills in Web scrapping for over 7 years long. I think you can just check my skill tests & work history from my profile. I've alway Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(57 Değerlendirme)

Hello scm1971 Hope you are doing good!! I have seen your requirement & understand your project "Custom Web Scraper and csv Import Tool" . I am expressing my interest toward this project specially because I ha Daha Fazla

in %bids___i_period_sub_35% gün içinde525%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(44 Değerlendirme)

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within Daha Fazla

in %bids___i_period_sub_35% gün içinde1555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(66 Değerlendirme)
1 gün içinde %bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% AUD
(98 Değerlendirme)

Hello. Hope you are doing well. I am a professional bot developer and have 10+ years experience. [login to view URL] [login to view URL] [login to view URL] Waiting for your positive response to make a grea Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(61 Değerlendirme)

Hello Simon, I have gone through your requirements. We are ready to build a scraper as per your mentioned requirements and also modify your price comparison plugin. We are happy to discuss about your project in deta Daha Fazla

in %bids___i_period_sub_35% gün içinde400%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(54 Değerlendirme)

Hi Sir, I'm a python programmer, i have done around 292 projects in freelancer and i have scraped several thousand websites so far. But, no where we have scraped more than one website with a single script. Every web Daha Fazla

in %bids___i_period_sub_35% gün içinde1500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(110 Değerlendirme)

hi,php+javascript developer here having great experience in scraping data from websites. i have gone through your requirements and i am interested and confident to finish your work in 7 days. plz go through my reviews Daha Fazla

in %bids___i_period_sub_35% gün içinde300%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(96 Değerlendirme)

Hello, I can help with you in your project Custom Web Scraper and csv Import Tool . I have more than 5 years of experience in Javascript, MySQL, PHP, Software Architecture, Web Scraping. We have worked on several si Daha Fazla

in %bids___i_period_sub_35% gün içinde750%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(61 Değerlendirme)

Hi, i'm a professional Web Automation Developer, and i can provide you with such scrapper that will go through 14 websites and collect data, please provide me with more details if you are interested, thanks.

in %bids___i_period_sub_35% gün içinde500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(53 Değerlendirme)

Hi, We will provide you Browsers-Compatible; Responsive[PC/ iPad/ iPhone/ MAC-Compatible]; SEO-friendly; Wordpress-Website. We believe in Prompt Communication; Value Your Money; Quality Assurance; Friendly GUI within Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(71 Değerlendirme)

Hello. I read your project description. I have many experience of ⭐webscraping⭐. and I have a ⭐ powerful tools for scrappping⭐. If you hire me, You will get good results. Thank you.

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(59 Değerlendirme)

Hi sir I understand and thanks for all the details, please give me a chance I will give you 100% work as per your requirements. Please let me know when start and when you need it. Hope to hear back from you t Daha Fazla

in %bids___i_period_sub_35% gün içinde446%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(92 Değerlendirme)
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(63 Değerlendirme)