Hadoop CDH4 and Eclipse Juno

Question

Has anyone been successful in creating an eclipse plugin for Juno versus installing CDH4?

I saw CDH3 all over the network. We are looking for CDH4. Thank you very much.

Answer 1

I'm not sure if you mean the Hadoop Eclipse plugin or the CDH4 code development plugin. I will answer both questions.

Juno Development Against CDH4: By far the easiest way to write applications with CDH4 components in Eclipse (any version) is to use m2eclipse [1] and add the Cloudera Maven repository to your pom.xml. In fact, a significant portion of the people in Cloudera (including me) do this regularly. Recently, one of our engineers (Natty) wrote a good blog post about getting started with CDH4, Maven and Eclipse [2] (and other IDEs). Otherwise, nothing is required to write applications from CDH4, except that they have a JAR. You can also view the Cloudera Maven repository here [3].

Hadoop Plugin: A long time ago, there was a plugin for Eclipse that allowed the execution of an MR job and some other bits. However, it has been preserved for a very long time (at least two to three years). I don’t think anyone ever updated it to work with Juno, not to mention Juno herself.

Hope this helps.

[1] http://bit.ly/UUGmlB [2] http://bit.ly/O6rkp6 [3] http://bit.ly/UUGwcC

Answer 2

I followed the instructions found at: http://iredlof.com/part-4-compile-hadoop-v1-0-4-eclipse-plugin-on-ubuntu-12-10/

System: local: Windows 7, Eclipse Juno (4.2.2), hadoop-1.2.1. Remote: Debian 7.1 with the same hadoop version.

I should mention that I built a plugin against vanilla hadoop-1.2.1, recently downloaded from apache.

Not everything works with the plugin: I can add a new MR location (deleted in my case), I can view / upload / download / delete files from DFS, but BUT I can't run my code (using Run as ... Run into Hadoop ) The console writes "ClassNotFoundException: WordCountReducer"

It is good that the jar generated by eclipse can be manually loaded into MR master and run from the command line.

Answer 3

You can get the Hadoop Eclipse plugin in this GitHub repository. https://github.com/winghc/hadoop2x-eclipse-plugin .

The post here presents how to integrate CDH5 and Eclipse Luna. http://speedy-elephant.blogspot.com/2015/08/the-real-getting-started-guide-cloudera.html