I am looking for a server-side web scraper. The script will run on our Linux dedicated server and download all the photo sets of a website (no login required).
There are about 5000 photo sets. Each set comes with a text description and contains about 10 photos. Each set will downloaded on our server in a separate folder and the set info will be stored in a DB.
That site updates daily and we wish to scrap that updates daily. A simple PHP script and CRON would probably work pretty well for that scraper.
You will also provide a web admin panel. It will be pretty simple, simply showing the running state of the scraper with basic commands like run/pause and possibly re-scrape. It will show the photo sets list with basic info and will offer a CSV export feature, so we can export the sets details (folder name, description, title,...)
We already have a similar scraper running and have a $200 budget for this new project.
Please let me know if you are interested and I will send you more details.
====== As discussed. please see PMB. Thanks. ======