I hope you are all having a lovely day.
There should be an API implemented (secured with Bearer Token only) that exposes the crawled data and lets the API consumer add new URLs to crawler.
It is very important, that the new crawler is reliable and the code should be as structured and modular as possible, to add logic, if e.g. a website is added. The crawler+API should run in Docker on an AWS EC2 instance.
I will provide you with the source code of the app, as soon as we start chatting.
- AWS S3, EC2, DynamoDB
Bu iş için 22 freelancer ortalamada €499 teklif veriyor
Hi there, I can write script in Node.js using Puppeteer according to your requirement. Please ping me back so I can start right away. Looking forward to hearing from you soon. Thanks & Regards Pooja Bohra
Hello, sir! How are you? I am a web scraping specialist. I have rich experience about web scraping. I've been using bs4, selenium or scrapy... I've ever scrapped dozens of sites at once also. At that time, there were a Daha Fazla