Error: not found: sqlContext value

Question

I would like to create a python application for analyzing twitter streaming data using Apache Spark.

Is there a way to use the Apache Spark streaming functionality without setting up a Hadoop environment. How to run Apache Spark offline? I just downloaded the binaries and tried to launch the spark shell, getting a NullPointerException. Maybe someone can help.

<console>:10: error: not found: value sqlContext
import sqlContext.implicits.

<console>:10: error: not found: value sqlContext
import sqlContext.sql

Answer 1

I install spark 1.5.2 using a homegrown, and when I started the spark shell, I met the same error. I am adding export SPARK_LOCAL_IP = 127.0.0.1 to .bashrc or .bash_profile. It works.

Answer 2

Spark 1.6, Linux/Unix, :

 ...
 java.net.UnknownHostException: <YOURHOSTNAME>: <YOURHOSTNAME>: unknown error at
 java.net.InetAddress.getLocalHost(InetAddress.java:1663)
 ...
 Caused by: java.net.UnknownHostException: <YOURHOSTNAME>: unknown error    
 ...
 <console>:16: error: not found: value sqlContext
                import sqlContext.sql

/etc/hosts:

 $ sudo vi /etc/hosts
 ...
 127.0.0.1  <YOURHOSTNAME>
 ...

sqlContext.