I am trying to test Zeppelin 0.6.2 using Spark 2.0.1 installed in Windows Server 2012.
I ran the Spark wizard and tested Spark Shell. Then I configured the following in the conf \ zeppeling-env.cmd file:
set SPARK_HOME=C:\spark-2.0.1-bin-hadoop2.7
set MASTER=spark://100.79.240.26:7077
I did not set HADOOP_CONF_DIR and SPARK_SUBMIT_OPTIONS (which is optional according to the documentation)
I checked the values on the Interpreter configuration page and the spark wizard Ok.
When I run the Zeppelin tutorial → “Load data into a spreadsheet”, please note that I am getting a connection failure error. Here are some of the messages in the error log:
INFO [2016-11-17 21: 58: 12,518] ({pool-1-thread-11} Paragraph.java [jobRun]: 252) - run item 20150210-015259_1403135953 using zero org.apache.zeppelin.interpreter.LazyOpenInterpreter @ 8bbfd7 INFO [2016-11-17 21: 58: 12,518] ({pool-1-thread-11} RemoteInterpreterProcess.java [link]: 148) - Starting the interpreter process [C: \ zeppelin-0.6.2-bin- all \ bin \ interpreter.cmd, -d, C: \ zeppelin-0.6.2-bin-all \ interpreter \ spark, -p, 50163, -l, C: \ zeppelin-0.6.2-bin-all / local -repo / 2C3FBS414] INFO [2016-11-17 21: 58: 12,614] ({Exec Default Executor} RemoteInterpreterProcess.java [onProcessFailed]: 288) - The interpreter {} org.apache.commons.exec.ExecuteException failed: process terminated with error: 255 (exit value: 255) at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404) at org.apache.commons.exec.Default Executor.access $ 200 (DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor $ 1.run (DefaultExecutor.java:200) in java.lang.Thread.run (Thread.java:745) ERROR [2016- 11-17 21: 58: 43,846] ({Thread-49} RemoteScheduler.java [getStatus]: 255) - Could not get status information org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException : java.net.ConnectException: connection rejected: connect at org.apache.zeppelin.interpreter.remote.ClientFactory.create (ClientFactory.java:53) at org.apache.zeppelin.interpreter.remote.ClientFactory.create (ClientFactory.java : 37) on org.apache.commons.pool2.BasePooledObjectFactory.makeObject (BasePooledObjectFactory.java:60) on org.apache.commons.pool2.impl.GenericObjectPool.create (GenericObjectPool.java:861) on org.apache.commons. pool2.impl.GenericObjectPool.borrowObject (GenericObjectPool.java:435) at org.apache.commo ns.pool2.impl.GenericObjectPool.borrowObject (GenericObjectPool. getStatus (RemoteScheduler.java:253) at org.apache.zeppelin.scheduler.RemoteScheduler $ JobStatusPoller.run (RemoteScheduler.java:211) Called: org.apache.thrift.transport.TTransportException: java.net.ConnectException connect at org.apache.thrift.transport.TSocket.open (TSocket.java:187) at org.apache.zeppelin.interpreter.remote.ClientFactory.create (ClientFactory.java:51) ... 8 more Reason: java. net.ConnectException: connection rejected: connect on java.net.DualStackPlainSocketImpl.connect0 (native method) on java.net.DualStackPlainSocketImpl.socketConnect (DualStackPlainSocketImpl.java:79) on java.net.AbstractPlainSocke tImpl.doConnect (AbstractPlainSocketImpl.java//39) on java.net.AbstractPlainSocketImpl.connectToAddress (AbstractPlainSocketImpl.java:200) on java.net.AbstractPlainSocketImpl.java:182Splava.plain.plain.plain.netplpl.plain.netplpl.plain.netplpl.plain.netplpl.plain.netplpl.netplpl.netplpl.netplpl.netplpl.netplpl.netplpl.netplpl.net .java: 172) on java.net.SocksSocketImpl.connect (SocksSocketImpl.javahaps92) on java.net.Socket.connect (Socket.java∗79) on org.apache.thrift.transport.TSocket.open (TSocket. java: 182) ... 9 more ERROR [2016-11-17 21: 58: 43,846] ({pool-1-thread-11} Job.java [run]: 189) - Error in the job org.apache.zeppelin. interpreter.InterpreterException: org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: connection rejected: connect to org.apache.zeppelin.interpreter.remote.RemoteInterpreter.repreter.repreter.repreter.repreter.repreter.repreter.repreter.repreter.repreter.repreter.repreter. .java: 165) on org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormT ype (RemoteInterpreter.java:328) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType (LazyOpenInterpreter.java:105) at org.apache.zeppelin.notebook.Paragraph.jobRun (Paragraph.javaache) .zeppelin.scheduler.Job.run (Job.java:176) at org.apache.zeppelin.scheduler.RemoteScheduler $ JobRunner.run (RemoteScheduler.java:328) in java.util.concurrent.Executors $ RunnableAdapter.call (Executors .java: 471) in java.util.concurrent.FutureTask.run (FutureTask.java:262) in java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.access $ 201 (ScheduledThreadPoolExecutor.java:178) in java.utecoolecutececececececilecoolecutececilececilececilececilececilececececileculecutil $ ScheduledFutureTask.run (ScheduledThreadPoolExecutor.java:292) in java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.Java: 1145) in java.util.concurrent.ThreadPoolExecutor $ Worker.run (ThreadjoolExecutor $ Worker.run. ThreadavaLec lang.Thread.run (Thread.java:745)
Zeppelin logs have only one file for zeppelin, the interpreter is an external Spark installation that does not log any errors because this is never achieved by the interpreter process. I read some suggestion about maximum and minimum JVM memory, but I have not been able to fix it yet. Any comment would be appreciated.
Floor
source share