Spark worker not connecting to master

Question

I want to create a spark autonomous cluster. I can run master and slave on the same node, but the slave on the other node does not show the master URL and does not connect to the master file.

I run the command:

start-slave.sh spark://spark-server:7077

where spark-serveris the host name of my master.

I can execute the ping command from an employee, but the WebUI of the wizard does not show a single employee, except that it works on the same computer. The node client works with the worker, but it is independent and not connected with the wizard.

Answer 1

spark-env.sh node. SPARK_MASTER_HOST IP- node? . , node IP - 192.168.0.1, SPARK_MASTER_HOST = 192.168.0.1. , .

Answer 2

1) , SSH

, , ssh

http://www.tecmint.com/ssh-passwordless-login-using-ssh-keygen-in-5-easy-steps/

2) IP- , $SPARK_HOME/conf

[ , conf] Master node

3) , IP- ,

[ start-all.sh script, $SPARK_HOME/sbin] Node

,

Answer 3

ping node Worker, , . node Spark, spark-env.sh , Spark CLuster .

, Spark Cluster mode