I bring Spark on Kubernet according to this example: https://github.com/kubernetes/kubernetes/tree/master/examples/spark
For some reason, I am having problems so that the wizard can listen :7077 for connections from work nodes. It seems that the connections are not proxied from the service. If I bring the service, then bring the main controller to the level of $SPARK_MASTER_IP set to the spark source, it correctly resolves the IP address of the service, but cannot bind the port. If I set ip to localhost instead, it binds the local port and appears -- since the services should redirect socket connections to the pod endpoint, this should be fine, so we move on.
Now I educate the workers. They try to connect to the IP address of the service :7077 and cannot. It seems that the connections to the service do not reach the endpoint. With the exception of...
I also have a webui service configured, as in the example. If I connect to it using kubectl --proxy, I can go to the web service that was at :8080 from the spark wizard by clicking it through the webui service. However, the almost identical configured spark master service on port 7077 does not give love. If I configure the wizard to bind the local IP address, it appears, but does not receive a connection from the service. If I configure it to bind through a service, the bind fails and cannot appear at all.
I'm running out of ideas as to why this might happen -- any help is appreciated. I am pleased to provide additional debugging information upon request.
source share