Everyday I'm manually going through a number of websites/forums dedicated to job announcements in a niche industry. I'm looking for a way to pull the respective information from all those sites together into a centralized interface/website to simplify things. I want to be able to check just one site, to get all the information I need from those source websites/forums.
Maybe the individual entries could be listed,by date and time as links to the original posts.
All of this should update automatically on a daily basis.
There should also be an error/success log, which confirms if pulling the information was successful and let's me know, if it fails - for instance, in the case of a change in layout/structure in one of the source websites.
I have a Linux server, where this should run. Additional help and support for installing is required.
At the moment we are talking about 5 websites that need to be checked daily, but I can see this to be extended in future, so that should be kept in mind. If this project is finished successfully, I may re-approach you in the future.
I already have a similar tool I can modify for you.
Bu iş için 12 freelancer ortalamada €180 teklif veriyor
Hi there, i am very interested to complete this project. please see my past reviews related to system administration lets complete this project
Hi, I have done crawler previously. Please check pmb for more detail. All the best, Steve.
Hi . i'm a web developer with more than 5 years experience in this field.i'm ready to start if you're interested !
Hi, I can work on this. I am expert in web automation. Thanks
Dear Employee! I've done jobs like this (actually I am creating one at the moment too). I have a good, own-developed system, which uses anonymous proxies to hide itself if needed. But I think if you want to search Daha Fazla
Hi. I am very keen to complete this project for you. I have developed similar systems before during my work with large companies in London over the last few years. Please see my profile for more info. Thanks - Jack
Hello, I can do this job with pleasure. We are neighbors :-)
Hi JacOdn I have done several scraper projects before, so I can get this project up and running for your pretty fast. I'll build you a website, which stores the scraped content in a database, updated on a daily bas Daha Fazla
I have built data aggregation and web scraping systems before and feel confident that your project will not cause issue.