I am trying to use Giraph on hadoop 2.6.0 with yarn.
I managed to create it by deleting STATIC_SASL_SYMBOL in <munge.symbols> in yarn profile . with the command:
sudo mvn -Phadoop_yarn -Dhadoop.version=2.6.0 -DskipTests package
Then I installed one node cluster with hadoop 2.6.0, and I can execute the basic wordcount example. I copied the jar built into the share/hadoop/mapreduce directory to remove the GiraphMaster procedure not found.
Now I'm trying to run the SimpleShortestPaths example with the command:
$HADOOP_PREFIX/bin/hadoop jar /usr/local/giraph/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.6.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip input_tiny2.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths445 -w 1 -ca giraph.SplitMasterWorker=false -yj giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.6.0-jar-with-dependencies.jar
The data used is a tiny graph on the giraph quick launch page, and it takes several minutes to complete the task, but it is not.
The full magazine is at http://pastebin.com/CW1FnWz2
Is it possible to make giraph work with hadoop 2.6.0 or do I need to use an earlier version? If so, which one would you suggest?
source share