I need to get a program written that would scrape and download coupons from different web sites ([url removed, login to view] etc). Number fo sites should be configurable Data needs to be saved in the SQL database (mysql). At a minimun the following information needs to be saved,
1. Coupon image
2. Coupon text
3. Web site from where coupon was downloaded
4. Expiry date
5. Categories or sub categories associated with the coupon
Program should be driven by configuration and can be executed multiple times a day.
If a coupon has already been downloaded, it should be ignored.
Ideally, all images should be downloaded and saved either in the database or on a content server (like S3) A reference to the image should be stored in the database.