Looking to Implement web-site parser for lyngsat.com. It should parse and store satellites, transponders, programs/channels, logos entities into local database Linux Dvb-s2 .
Requirements:
Implement with Python 2.7, Scrapy, daemonize with ScrapyD
Scrap [login to view URL] and its subprojects if needed ([login to view URL],[login to view URL],[login to view URL])
Scrap all the entities/attributes/relationships described in data model (see [login to view URL] attached)
Ability to run in incremental update mode. With every new run to update existing database with newly scrapped data
Configuration with yml file (see [login to view URL] attached)
Extensive console and file logging on all stages of scrapping on different log levels
Clean structured readable source code with basic documentation
Step-by-step deployment instruction for RHEL 6/7