search

sryza / spark-ts-examples

Spark TS Examples
Apache License 2.0
120 stars 79 forks source link

sc = SparkContext(appName="Stocks") - Spark context creation Error #10

Open rajeshdoma opened 7 years ago

rajeshdoma commented 7 years ago

Hi, I am using following to execute Stocks.py example spark-submit --driver-class-path sparkts-0.4.1-jar-with-dependencies.jar Stocks.py I see below Error.My Spark context is failing.can you please help. Traceback (most recent call last): File "/home/doma.rd/Stocks.py", line 28, in sc = SparkContext(appName="Stocks") File "/opt/cloudera/parcels/CDH-5.10.1-1.cdh5.10.1.p0.10/lib/spark/python/lib/pyspark.zip/pyspark/context.py", line 115, in init File "/opt/cloudera/parcels/CDH-5.10.1-1.cdh5.10.1.p0.10/lib/spark/python/lib/pyspark.zip/pyspark/context.py", line 172, in _do_init File "/opt/cloudera/parcels/CDH-5.10.1-1.cdh5.10.1.p0.10/lib/spark/python/lib/pyspark.zip/pyspark/context.py", line 235, in _initialize_context File "/opt/cloudera/parcels/CDH-5.10.1-1.cdh5.10.1.p0.10/lib/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 1064, in call File "/opt/cloudera/parcels/CDH-5.10.1-1.cdh5.10.1.p0.10/lib/spark/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 308, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext. : java.lang.NoSuchMethodError: scala.runtime.VolatileByteRef.create(B)Lscala/runtime/VolatileByteRef;