I own a web scraper in Python 3, which uses Selenium. It connects to good quality private proxy and scrapes the website using Chrome browser, exporting content to HTML files.
The problem is the scraper is getting 0.1 score (1.0 is maximum), which is too low and searching on site is being blocked due to unusual traffic. When searching manually without using the scraper, my score is 0.9 (when logged to Gmail account).
I assume that the problem is Google's verification system v3 (no images, just score) is detecting the bot.
Scraper remembers the login and password to Gmail account, as it should increase the score but Google blocked the try of logging in, due to critical error (unauthorized use of password).
Scraper uses chrome driver.
0.5 score would be enough to scrape.
I own a source code.
If you are interested in fixing this problem, please post an offer.
Important: Please describe what is your idea on fixing the problem. If you advice to create totally new scraper, please also describe how it would work. I respect your know-how, but please be precise as possible.
It could be reCAPTCHA made by google. First of all, you need to check html responses to see, if it exists. If problem is connected with captcha, you need to use api from paid source, that will take captcha and solve it Daha Fazla
Bu iş için 19 freelancer ortalamada $147 teklif veriyor
Dear Hiring Manager.⭐ I am a python programmer and I have faced many python problems.. Hope you give this project to me.. Relevant Skills and Experience I have worked with python + web development with Django framewor Daha Fazla
I can help you, I need to see code to see how scraper works. Some of projects -> [login to view URL]