LocalJobRunner was chosen as your configuration, most likely it has the mapred.job.tracker property set to local , or it was not set at all (in this case, the default value is local). To check, go to "wherever you extracted / installed hadoop" / etc / hadoop / and see if the mapred-site.xml file exists (for me it wasn’t, there was a file called mapped-site.xml.template ) In this file (or create it if it does not exist) make sure that it has the following property:
<configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> </configuration>
- See source
org.apache.hadoop.mapred.JobClient.init(JobConf)
What is the meaning of this configuration property in the hadoop configuration on the machine with which you are sending it? Also confirm that the hasoop executable that you are working on refers to this configuration (and that you do not have 2+ settings configured differently) - enter which hadoop and trace any symbolic links you come across.
Alternatively, you can override this when submitting a job if you know the JobTracker host number and port number using the -jt option:
hadoop jar MyRandomForest_oob_distance.jar -jt hostname:port hdfs://montana-01:8020/user/randomforest/input/genotype1.txt hdfs://montana-01:8020/user/randomforest/input/phenotype1.txt hdfs://montana-01:8020/user/randomforest/output1_distance/ hdfs://montana-01:8020/user/randomforest/input/genotype101.txt hdfs://montana-01:8020/user/randomforest/input/phenotype101.txt 33 500 1