I am looking for a developer that is experienced in crawlers and especially the Heritrix crawler. We have a Heritrix crawler set up on Fedora Linux that is posting to a Solr Search engine.
we need someone that can tame the beast and help us in setting it up in such a way that it will only crawl specific parts of each website we require.
Bu iş için 7 freelancer ortalamada $900 teklif veriyor
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
Hello I am interested in this project please check your inbox Thanks
Hello, we are a company experienced in developing Internet crawlers and spiders. We have developed own crawler from scratch, with evident advantages! So, we are familiar with many open-source and commercial spiders. Daha Fazla
I am Linux sysadmin with experience in web crawlers. I'd be glad to help you out with this.
I have 5 exp year with linux system ! Contact me as soon as posible to do this project ! Thank you !
Prior experience in large scale data processing and search ( setting up solr schema in lucene with complex analyzers + payloads for ranking ). Developed custom crawlers + heritrix / nutch crawlers to do some large Daha Fazla