Hi~ I am new to this platform. And I want to scrape more than 2~3M of urls.
I already written a script that only runs on MacOS which use App Script.
This is essential condition. Currently only single machine can run a single script.
So if you are an expert of App Script or you have multiple number of MacOS then it's applicable on this project.
The site is protected by “Distil Network” which makes scrapping real hard.
Bu iş için 4 freelancer ortalamada $232 teklif veriyor
I Could build you an application from which you can run multiple instances of your script. It's not easy, it's complicated, and therefore expensive, but it will work.