All geek questions in one place

Spark Script for Hadoop EC2 Installation: IPC Client Connection Denied

I tried to use distcp to copy between Hadoop and Amazon S3 on setting up an EC2 cluster using spark scripts for EC2

[root]# bin/hadoop distcp s3n://bucket/f1 hdfs:///user/root/

The error I received was

 INFO ipc.Client: Retrying connect to server: .. Already tried n time(s). Copy failed: java.net.ConnectException: Call to ..my_server failed on connection excep\ tion: java.net.ConnectException: Connection refused
+4
source share
1 answer

Spark EC2 scripts may not intentionally start JobTracker and TaskTracker services. Therefore, after running the Spark EC2 installation scripts to start the services, I started

 {HADOOP_HOME}/bin/start-all.sh

Link: Thank you Brock Noland at https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/H6wAfdeLIJo

+5
source

Source: https://habr.com/ru/post/1495556/

More articles:


All Articles