I am a talented Web Scraper who has rich experience for a few years.
I am familiar with Scrapy, Selenium, and Beautiful Soup.
I have crawled around 10k sites successfully.
I have some tricks to avoid Captcha and some kind of site limitations.
I am flexible to use Proxies and User Agents.
Most of crawlers work getting along with databases such as Mongo, Mysql, PostgreSql and Firebase.
Also AWS, Google Cloud, Azure, Scrapinghub and digital Ocean are my favourite servers that I prefer to deploy the scrapers.
Some crawlers are integrated with Django and Flask to feed data in real-time.
I also have rich experience to build a system based on crawlers.
The system includes mutiple functions such as daily crawling, data processing, transferring via api, email warning, distribution, reports, multi charts and updating db in real-time.
The system provides the clients with a big help to run their own business and beat their competitors.
I am trying to satisfy the clients as much as possible with my dedicated and honest work.
Please contact me and discuss your project.