Failed to start wizard for spark in windows 10

I am new to Spark, I am trying to start the wizard manually (using MINGW64 on Windows 10).

When I do this, ~/Downloads/spark-1.5.1-bin-hadoop2.4/spark-1.5.1-bin-hadoop2.4/sbin $ ./start-master.sh

I got these magazines,

 ps: unknown option -- o Try `ps --help' for more information. starting org.apache.spark.deploy.master.Master, logging to /c/Users/Raunak/Downloads/spark-1.5.1-bin-hadoop2.4/spark-1.5.1-bin-hadoop2.4/sbin/../logs/spark--org.apache.spark.deploy.master.Master-1-RINKU-CISPL.out ps: unknown option -- o Try `ps --help' for more information. **failed to launch org.apache.spark.deploy.master.Master:** Spark Command: C:\Program Files\Java\jre1.8.0_77\bin\java -cp C:/Users/Raunak/Downloads/spark-1.5.1-bin-hadoop2.4/spark-1.5.1-bin-hadoop2.4/sbin/../conf\;C:/Users/Raunak/Downloads/spark-1.5.1-bin-hadoop2.4/spark-1.5.1-bin-hadoop2.4/lib/spark-assembly-1.5.1-hadoop2.4.0.jar;C:\Users\Raunak\Downloads\spark-1.5.1-bin-hadoop2.4\spark-1.5.1-bin-hadoop2.4\lib\datanucleus-api-jdo-3.2.6.jar;C:\Users\Raunak\Downloads\spark-1.5.1-bin-hadoop2.4\spark-1.5.1-bin-hadoop2.4\lib\datanucleus-core-3.2.10.jar;C:\Users\Raunak\Downloads\spark-1.5.1-bin-hadoop2.4\spark-1.5.1-bin-hadoop2.4\lib\datanucleus-rdbms-3.2.9.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip RINKU-CISPL --port 7077 --webui-port 8080 

What am I doing wrong, Should I configure the Hadoop package also for Spark?

+1
source share
1 answer

Just found the answer here: https://spark.apache.org/docs/1.2.0/spark-standalone.html

"Note: startup scripts are not currently supported by Windows. To start the Spark cluster on Windows, start the wizard and workers manually."

I think Windows is not a good choice for Spark, anyway good luck!

+1
source

Source: https://habr.com/ru/post/1247023/


All Articles