How to change spark.ui.port?

Question

I use the spark-submit function and try to do this in a jar file with .setExecutorEnv("spark.ui.port", "4050") in the spark context, but it still tried to hit 4040. Then I tried to install --conf spark.ui.port=4050 after spark-submit and before --class CLASSNAME , but that didn’t work either, this time saying “Error: unrecognized option“ --conf ". How can I get around this? Actual error that I encounter is that there is an active spark server that others use, which prevents this spark-dispatch from starting the berth server, then it doesn’t hit other ports, so I try yus I get to do it.

Answer 1

--conf spark.ui.port=4050 - Spark 1.1 function. You can install it in your codes, for example:

 val conf = new SparkConf().setAppName(s"SimpleApp").set("spark.ui.port", "4050") val sc = new SparkContext(conf)