You need to create Spark before running this program error when running bin / pyspark

Question

I start with Spark.

I am having a problem when starting a spark.

I downloaded sparks from the official site, I try to quickly start with this https://spark.apache.org/docs/0.9.0/quick-start.html

I downloaded, setup sparkhome., And when I tried to run. / pyspark from the bin directory, I get this error:

soundarya@soundarya :~/Downloads/spark-1.5.0/bin$ sudo ./pyspark [sudo] password for soundarya: ls: cannot access /home/soundarya/Downloads/spark-1.5.0/assembly/target/scala-2.10: No such file or directory Failed to find Spark assembly in /home/soundarya/Downloads/spark-1.5.0/assembly/target/scala-2.10. You need to build Spark before running this program. soundarya@soundarya :~/Downloads/spark-1.5.0/bin$ 

Can someone help me figure this out?

Answer 1

If you want to use the source distribution, you first need to create Spark. Details can be found in Building Spark .

Otherwise, just download the binary distribution (select the pre-built one) from the downloads:

Also do not use outdated documentation. You can use either the latter:

http://spark.apache.org/docs/latest

or specific version

http://spark.apache.org/docs/1.5.0

Answer 2

Download the preliminary spark, for example, null 323. In addition, it is not recommended to use a spark in sudo mode.

Answer 3

Check the place in the name of your spark folder like spark 2.4, then delete it and have spark-2.4 fix the problem