Nutch expert needed
$15-25 USD / hora
We have a project to scrap data and to store data in hdfs. We need a skilled engineer to assistant in this task. Your work will be to implement Nutch and to get Nutch running as a demo to scrap data and store the data in hdfs.
You will need skills as follows -
1. Ubuntu 14.04, this is command based with commands to manipulate files, install software, and log data
2. Java 1.7 with Eclipse, understanding classes, methods, debugging, maven, jar files.
3. Nutch, understanding how to scrap data
4. HDFS & Hadoop - understanding how to get HDFS working and to integrate with Nutch.
This is a demo project and no production level data is needed but we need the basic system to work effective. Any knowledge of Javascript and scraping Javascript websites is a bonus. An extra bonus is knowledge of elasticsearch.
Nº del proyecto: #10794973
Sobre el proyecto
Adjudicado a:
20 freelancers están ofertando un promedio de $22 / hora por este trabajo
We are web & mobile development team of JinDongZhe freelancer We have powerful back-end(Java,Spring Framework, Hibernate, JPA, Oracle, Hadoop etc) and front-end(Android, iPhone, Hybrid App, Mobile web, Sencha ExtJS, Más
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Más
Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites including yellowpages, yelp and e-commerce websites including amazon, walmart etc and many more. We c Más
I am a Nutch expert and I have developed SEO engine by using Nutch. The final version of the Nutch is 2.3.1 and it updated very well. As you can see from my profile, I have a lot of skills and my main language was JA Más
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction. I usually finish project Más
Hi, I have experience in using nutch for crawling. I have also customized the nutch crawler on one occassion. Apache Nutch was created by the creator of hadoop, and it is closely related with hadoop ecosystem projec Más
Already completed 5 projects in Hadoop and Big data with good accuracy. Have 6 years of IT Experience with 3+ purely on big data only
Experienced in setup of Nutch using Ambari and Hortonworks distribution. Time required to complete this demo project would depend on the scraping needs.
school@CLI:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 14.04.4 LTS Release: 14.04 Codename: trusty school@CLI:~$
