search

Stratio / spark-rabbitmq

RabbitMQ Spark Streaming receiver
Apache License 2.0
208 stars 84 forks source link

java.lang.ClassNotFoundException: org.apache.spark.streaming.rabbitmq.RabbitMQUtils #105

Open rkamaleswaran opened 7 years ago

rkamaleswaran commented 7 years ago

Hi all,

I wrote a simple custom receiver to grab messages from RabbitMQ into spark streaming (using spark-rabbitmq 0.5.1, and spark 2.0.2). However, when I run the file, I get the following error:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/streaming/rabbitmq/RabbitMQUtils$
    at CustomReceiver$.main(SparkReceiver.scala:25)
    at CustomReceiver.main(SparkReceiver.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:736)
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.rabbitmq.RabbitMQUtils$
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 11 more

Please let me know how I can proceed from here, thank you!

compae commented 7 years ago

It's possible that you don't generate one fat jar with dependencies?