search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.3k stars 21.48k forks source link

NoClassDefFoundError #78272

Closed SAURABH-MS closed 3 years ago

SAURABH-MS commented 3 years ago

Code is throwing error when trying to execute.

Error : NoClassDefFoundError: org/apache/spark/internal/Logging$class

It seems to be a problem with spark version but not sure.

Stack trace: at org.apache.spark.eventhubs.EventHubsConf$.(EventHubsConf.scala:460) at org.apache.spark.eventhubs.EventHubsConf$.(EventHubsConf.scala) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw$$iw$$iw.(command-596280046283584:16) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw$$iw.(command-596280046283584:79) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw.(command-596280046283584:81) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw.(command-596280046283584:83) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw.(command-596280046283584:85) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw.(command-596280046283584:87) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read.(command-596280046283584:89) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$.(command-596280046283584:93) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$.(command-596280046283584) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval$.$print$lzycompute(:7) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval$.$print(:6) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval.$print() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:745) at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1021) at scala.tools.nsc.interpreter.IMain.$anonfun$interpret$1(IMain.scala:574) at scala.reflect.internal.util.ScalaClassLoader.asContext(ScalaClassLoader.scala:41) at scala.reflect.internal.util.ScalaClassLoader.asContext$(ScalaClassLoader.scala:37) at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:41) at scala.tools.nsc.interpreter.IMain.loadAndRunReq$1(IMain.scala:573) at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:600) at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:570) at com.databricks.backend.daemon.driver.DriverILoop.execute(DriverILoop.scala:219) at com.databricks.backend.daemon.driver.ScalaDriverLocal.$anonfun$repl$1(ScalaDriverLocal.scala:235) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at com.databricks.backend.daemon.driver.DriverLocal$TrapExitInternal$.trapExit(DriverLocal.scala:903) at com.databricks.backend.daemon.driver.DriverLocal$TrapExit$.apply(DriverLocal.scala:856) at com.databricks.backend.daemon.driver.ScalaDriverLocal.repl(ScalaDriverLocal.scala:235) at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$13(DriverLocal.scala:544) at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:240) at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:235) at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:232) at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:53) at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:279) at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:271) at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:53) at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:521) at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:689) at scala.util.Try$.apply(Try.scala:213) at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:681) at com.databricks.backend.daemon.driver.DriverWrapper.getCommandOutputAndError(DriverWrapper.scala:522) at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:634) at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:427) at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:370) at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:221) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:419) at com.databricks.backend.daemon.driver.ClassLoaders$LibraryClassLoader.loadClass(ClassLoaders.scala:151) at java.lang.ClassLoader.loadClass(ClassLoader.java:352) at org.apache.spark.eventhubs.EventHubsConf$.(EventHubsConf.scala:460) at org.apache.spark.eventhubs.EventHubsConf$.(EventHubsConf.scala) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw$$iw$$iw.(command-596280046283584:16) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw$$iw.(command-596280046283584:79) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw$$iw.(command-596280046283584:81) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw$$iw.(command-596280046283584:83) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw$$iw.(command-596280046283584:85) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$$iw.(command-596280046283584:87) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read.(command-596280046283584:89) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$.(command-596280046283584:93) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$read$.(command-596280046283584) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval$.$print$lzycompute(:7) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval$.$print(:6) at $linefe37f28de1f64ebbafdc9615e7a7d35e25.$eval.$print() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:745) at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1021) at scala.tools.nsc.interpreter.IMain.$anonfun$interpret$1(IMain.scala:574) at scala.reflect.internal.util.ScalaClassLoader.asContext(ScalaClassLoader.scala:41) at scala.reflect.internal.util.ScalaClassLoader.asContext$(ScalaClassLoader.scala:37) at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:41) at scala.tools.nsc.interpreter.IMain.loadAndRunReq$1(IMain.scala:573) at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:600) at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:570) at com.databricks.backend.daemon.driver.DriverILoop.execute(DriverILoop.scala:219) at com.databricks.backend.daemon.driver.ScalaDriverLocal.$anonfun$repl$1(ScalaDriverLocal.scala:235) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at com.databricks.backend.daemon.driver.DriverLocal$TrapExitInternal$.trapExit(DriverLocal.scala:903) at com.databricks.backend.daemon.driver.DriverLocal$TrapExit$.apply(DriverLocal.scala:856) at com.databricks.backend.daemon.driver.ScalaDriverLocal.repl(ScalaDriverLocal.scala:235) at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$13(DriverLocal.scala:544) at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:240) at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:235) at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:232) at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:53) at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:279) at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:271) at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:53) at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:521) at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:689) at scala.util.Try$.apply(Try.scala:213) at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:681) at com.databricks.backend.daemon.driver.DriverWrapper.getCommandOutputAndError(DriverWrapper.scala:522) at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:634) at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:427) at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:370) at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:221) at java.lang.Thread.run(Thread.java:748)

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

KranthiPakala-MSFT commented 3 years ago

Hi @saurabh-teck Thank you for reaching out. At this time we are reviewing the ask and will provide an update as appropriate

KranthiPakala-MSFT commented 3 years ago

Hi @saurabh-teck - Could you please confirm if you are following the exact steps mentioned in the tutorial and facing this issue? or is this an issue with your own/custom application/code?

SAURABH-MS commented 3 years ago

Hi @KranthiPakala-MSFT - My data is already coming in Eventhub from IOT device, so I am not sending the data to EventHub I am only using the reading part. Basically, I am not using Twitter4j libraries.

KranthiPakala-MSFT commented 3 years ago

Hi @SAURABH-MS

Thanks for your response and leveraging Azure docs feedback channel to raise this question. This channel is reserved for ‘Azure docs’ feedback- for sharing doc feedback and suggesting content improvements. We didn't determine any changes for this documentation upon reviewing this feedback.

If your issue is specific to a use case, we request you to please reach out in forums like Microsoft Q&A or Stackoverflow. We have our engineers and other community members who will be happy to assist. Forums have a better suited audience for such queries.

Once your issue is posted in forum, please do share the forum thread link here for tracking.

If you have a document which you are following and if you think it needs an update, please let us know about that here.

We will now proceed to close this thread. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.

Thank you

SAURABH-MS commented 3 years ago

Update : Issue got solved by using com.microsoft.azure:azure-eventhubs-spark_2.12:2.3.17 instead of the older version mentioned in the doc.