We need a screen scraper for the job listings on nav.no. The scraper should monitor the source continuously to synchronize inserts, updates and deletes. The data of each listing should be parsed into a structured format that we specify and stored as json in the db specified in the Rails config file.
The scraper should run as a daemons gem process that loads Rails. We will provide details and the framework for doing this.
- It must be programmed in Ruby using the nokogiri gem
- The code must extremely neat and well structured.
- No documentation or test programs needs to be written.
Please specify if you have built similar software.
6 freelancer bu iş için ortalamada 288$ teklif veriyor
I have experience with screen scrapping and Nokogiri. Automation and daemonation can be done with Background Jobs or Starling, with which I have worked with recently too.