We have a 3 spiders built in Python using Scrapy that run on a Google Compute Virtual Machine (on Debian) on Google Cloud Platform. Currently, as soon as the srapers finish, they restart and run again.
We need to add the ability for them to run at intervals (every 15 minutes, for example, or every hour). This interval needs to be something we can modify later if we want to.
We also need to add the ability for them to not run during certain hours (from 12 AM - 6 AM, for example). These hours need to be something we can change later if we want to.
Hi there! It could be built in the same python script without using bash or any other conf. If you're interested message me and we can do a try with that! Good luck!
Bu iş için 15 freelancer ortalamada $121 teklif veriyor
Hi, I have 6 years of experience in python and web scrapping. I have great experience in scheduling program to run at a specific time. I can help you to schedule your program for a specific interval by creating a shell Daha Fazla
Hello sir We have 2+ years of experience on scheduling and reporting task. We assure you to deliver you the requirements on or before time with full satisfaction.
Hello, I can do this job and provide good interface to you to change scheduling whenever you want. We can descuss details if you want. Regards, Andranik