Closed n1o closed 8 years ago
knockdata
commented
8 years ago Thanks very much for trying zeppelin-highcharts.
zeppelin-highcharts by default is compiled with Spark 1.6. It has not been verified on Spark 2.0 yet.
I will add maven profile to support both Spark 1.6 and 2.0 in the coming days.
rockie-yang
commented
8 years ago I just tested on commit 85d4df4f0c9801751abad57004760ccc10d1eb82.
When I run with default build which is spark-2.0 & scala-2.10. sc.version can NOT be executed correctly.
mvn clean package -DskipTestsWhen I compile scala-2.11. sc.version can be executed correctly.
mvn clean package -Pspark-2.0 -Pscala-2.11 -DskipTests@n1o Please test without zeppelin-highcharts to see if it works in your setup.
rockie-yang
commented
8 years ago @n1o I added spark 2.0 support. Please verify if it's working. Ref to the latest README.md file, I have updated to add spark 2.0 support.
zeppelin is compiled with
mvn clean package -Pspark-2.0 -Pscala-2.11 -DskipTestszeppelin-highcharts is compiled with
mvn clean package -Pspark-2.0 -DskipTests
n1o
commented
8 years ago Hey, your amazing 👍 everything works fine. I am going to close this issue
hellozeck
commented
7 years ago @n1o How do you fix it ? Have you truned on https://zeppelin.apache.org/docs/0.7.0/manual/userimpersonation.html
And my exception is beblow :
INFO [2017-04-05 19:33:00,821] ({qtp464712996-59} InterpreterFactory.java[createInterpretersForNote]:813) - Interpreter org.apache.zeppelin.spark.DepInterpreter 1455029769 created
INFO [2017-04-05 19:33:00,822] ({qtp464712996-59} InterpreterFactory.java[createInterpretersForNote]:813) - Interpreter org.apache.zeppelin.spark.PySparkInterpreter 1289039194 created
INFO [2017-04-05 19:33:00,824] ({qtp464712996-59} InterpreterFactory.java[createInterpretersForNote]:813) - Interpreter org.apache.zeppelin.spark.SparkRInterpreter 1066702622 created
INFO [2017-04-05 19:33:09,299] ({qtp464712996-14} NotebookServer.java[broadcastNewParagraph]:640) - Broadcasting paragraph on run call instead of note.
INFO [2017-04-05 19:33:09,352] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:131) - Job paragraph_1491391980306_-1053189884 started by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1940653804
INFO [2017-04-05 19:33:09,354] ({pool-2-thread-2} Paragraph.java[jobRun]:344) - run paragraph 20170405-193300_1269924135 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@2075cb15
INFO [2017-04-05 19:33:09,369] ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:120) - Run interpreter process [/home/zengweizhan/zeppelin-0.7.0/bin/interpreter.sh, -d, /home/zengweizhan/zeppelin-0.7.0/interpreter/spark, -p, 5445, -u, hadoop, -l, /home/zengweizhan/zeppelin-0.7.0/local-repo/2CF9YF8AU]
INFO [2017-04-05 19:33:10,966] ({Exec Default Executor} RemoteInterpreterManagedProcess.java[onProcessComplete]:164) - Interpreter process exited 0
WARN [2017-04-05 19:33:39,494] ({pool-2-thread-2} ClientFactory.java[create]:57) - host: localhost ;port: 5445
WARN [2017-04-05 19:33:39,494] ({Thread-41} ClientFactory.java[create]:57) - host: localhost ;port: 5445
ERROR [2017-04-05 19:33:39,495] ({pool-2-thread-2} Job.java[run]:188) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:211)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:375)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:365)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:58)
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:39)
at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:90)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:209)
... 12 more
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift.transport.TSocket.open(TSocket.java:187)
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:55)
... 19 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at org.apache.thrift.transport.TSocket.open(TSocket.java:182)
... 20 more
ERROR [2017-04-05 19:33:39,495] ({Thread-41} RemoteScheduler.java[getStatus]:256) - Can't get status information
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:58)
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:39)
at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:90)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:254)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.run(RemoteScheduler.java:212)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift.transport.TSocket.open(TSocket.java:187)
at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:55)
... 8 more
Hey,
your project seems promising, i really miss some visualization library for Scala + Spark in Zeppelin. But since i added your package as a dependency I am running into this exception:
I cant really tell anything meaningful from the exception.
I am running it on spark 2.0 and Zeppelin built from the actual master branch. I am not sure if this error is related to your package or with my setup. So if you fail to reproduce the error feel free to close this issue.