I need someone very skilled in ruby web scraping to help me with mechanize or selenium-webdriver.
I have two scripts which do same job, but firstly I tried with mechanize, and everything work corectly but I cant make script to work in parallel gem.
Same thing with selenium webdriver, works perfectly but cant make it to work with parallel gem.
I am open to any sugestion on some other gems, like typhoeus, or something other, I just want to speed up my script, so it can scrape some data much faster.
Selenium is realy slow, so I prefer this to be done with mechanize.
But also, mechanize need to work much faster.
I have proxies, which works good, and when I set up mechanize to use different proxies in parallel after some time I recieve error.
So, your job will be just to fix this script, and to explaine me how is that done.
I am sure that someone with expiriance with working with mechanize in parallel will finish this in max 15 minutes.
Please bid only if you realy have expiriance with this.
Lowest price will win.
5 freelancer bu iş için ortalamada 27$ teklif veriyor
Hi, I used to write a lot of scripts with mechanize and I think that I know what is the problem. Would be nice to work with you! Can start debugging monday morning UTC+04
there is a easy way that you can run your script in parallel, just run it again like ruby [url removed, login to view] ruby [url removed, login to view] ruby [url removed, login to view] so that you have 3 process of ruby script or you could modify your script to use Daha fazlası
I have 4 years experience with python and ruby + web scraping and data manipulation . I've recently done 2 projects with selenium-webriver and mechanize - both python and ruby.