Nutch expert needed
$15-25 USD / saat
We have a project to scrap data and to store data in hdfs. We need a skilled engineer to assistant in this task. Your work will be to implement Nutch and to get Nutch running as a demo to scrap data and store the data in hdfs.
You will need skills as follows -
1. Ubuntu 14.04, this is command based with commands to manipulate files, install software, and log data
2. Java 1.7 with Eclipse, understanding classes, methods, debugging, maven, jar files.
3. Nutch, understanding how to scrap data
4. HDFS & Hadoop - understanding how to get HDFS working and to integrate with Nutch.
This is a demo project and no production level data is needed but we need the basic system to work effective. Any knowledge of Javascript and scraping Javascript websites is a bonus. An extra bonus is knowledge of elasticsearch.
Proje NO: #10794973
Proje hakkında
Seçilen:
Bu iş için 20 freelancer ortalamada $22/saat teklif veriyor
We are web & mobile development team of JinDongZhe freelancer We have powerful back-end(Java,Spring Framework, Hibernate, JPA, Oracle, Hadoop etc) and front-end(Android, iPhone, Hybrid App, Mobile web, Sencha ExtJS, Daha Fazla
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Daha Fazla
Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites including yellowpages, yelp and e-commerce websites including amazon, walmart etc and many more. We c Daha Fazla
Dear Client, Greetings from Flowgica technologies, I have experience with these skills. We do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. please ch Daha Fazla
I am a Nutch expert and I have developed SEO engine by using Nutch. The final version of the Nutch is 2.3.1 and it updated very well. As you can see from my profile, I have a lot of skills and my main language was JA Daha Fazla
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction. I usually finish project Daha Fazla
Hi, I have experience in using nutch for crawling. I have also customized the nutch crawler on one occassion. Apache Nutch was created by the creator of hadoop, and it is closely related with hadoop ecosystem projec Daha Fazla
Already completed 5 projects in Hadoop and Big data with good accuracy. Have 6 years of IT Experience with 3+ purely on big data only
My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & Daha Fazla
Experienced in setup of Nutch using Ambari and Hortonworks distribution. Time required to complete this demo project would depend on the scraping needs.
school@CLI:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 14.04.4 LTS Release: 14.04 Codename: trusty school@CLI:~$
Dear Sir/Madam, My name is Jenida from 41studio Website and Mobile Development Company in Indonesia. We are a group of mobile and web developers having expertise in developing web and mobile applications for over Daha Fazla
