search

RuckusWirelessIL / pentaho-kafka-consumer

Apache Kafka consumer step plug-in for Pentaho Kettle
Apache License 2.0
66 stars 40 forks source link

Using consumer with pdi 6.1.0.3 enterprise - java.lang.linkageError: loader constraint violation #17

Closed johnpaularthur closed 7 years ago

johnpaularthur commented 8 years ago

Fresh kettle installation with cdh54 big-data-plugin. Kafka plugins install from marketplace.

The producer works great, but upon running the consumer, i get 2 errors. The first error is from the client itself, the second is what spoon.sh reports. Can you help identify what I'm doing wrong?

first error (client ui): java.lang.NullPointerException at org.pentaho.di.trans.Trans.fireTransFinishedListeners(Trans.java:1466) at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1124) at org.pentaho.di.ui.spoon.trans.TransGraph.debug(TransGraph.java:3803) at org.pentaho.di.ui.spoon.delegates.SpoonTransformationDelegate.executeTransformation(SpoonTransformationDelegate.java:879) at org.pentaho.di.ui.spoon.Spoon$31$1.run(Spoon.java:8523) at org.eclipse.swt.widgets.RunnableLock.run(Unknown Source) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Unknown Source) at org.eclipse.swt.widgets.Display.runAsyncMessages(Unknown Source) at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source) at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1347) at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7989) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9269) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:663) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)

second error (spoon.sh command output). 2016/08/11 15:49:53 - consumer - Dispatching started for transformation [consumer] 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - ERROR (version 6.1.0.3-223, build 1 from 2016-06-16 15.11.37 by buildguy) : Error initializing step [Apache Kafka Consumer] 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - ERROR (version 6.1.0.3-223, build 1 from 2016-06-16 15.11.37 by buildguy) : java.lang.LinkageError: loader constraint violation: loader (instance of org/pentaho/di/core/plugins/KettleURLClassLoader) previously initiated loading for a different type with name "org/w3c/dom/Node" 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.ClassLoader.defineClass1(Native Method) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.ClassLoader.defineClass(ClassLoader.java:760) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.net.URLClassLoader.access$100(URLClassLoader.java:73) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.net.URLClassLoader$1.run(URLClassLoader.java:368) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.net.URLClassLoader$1.run(URLClassLoader.java:362) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.security.AccessController.doPrivileged(Native Method) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.net.URLClassLoader.findClass(URLClassLoader.java:361) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.pentaho.di.core.plugins.KettleURLClassLoader.loadClassFromThisLoader(KettleURLClassLoader.java:78) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.pentaho.di.core.plugins.KettleURLClassLoader.loadClass(KettleURLClassLoader.java:101) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.ClassLoader.loadClass(ClassLoader.java:357) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.Class.forName0(Native Method) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.Class.forName(Class.java:264) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.apache.log4j.helpers.Loader.loadClass(Loader.java:182) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:326) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:472) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.apache.log4j.LogManager.<clinit>(LogManager.java:127) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.apache.log4j.Logger.getLogger(Logger.java:104) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.Logging$class.logger(Logging.scala:24) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.VerifiableProperties.logger$lzycompute(VerifiableProperties.scala:26) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.VerifiableProperties.logger(VerifiableProperties.scala:26) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.Logging$class.info(Logging.scala:67) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.VerifiableProperties.info(VerifiableProperties.scala:26) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.utils.VerifiableProperties.verify(VerifiableProperties.scala:217) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:95) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at com.ruckuswireless.pentaho.kafka.consumer.KafkaConsumerStep.init(KafkaConsumerStep.java:64) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:69) 2016/08/11 15:49:53 - Apache Kafka Consumer.0 - at java.lang.Thread.run(Thread.java:745) 2016/08/11 15:49:53 - consumer - ERROR (version 6.1.0.3-223, build 1 from 2016-06-16 15.11.37 by buildguy) : Step [Apache Kafka Consumer.0] failed to initialize!

spektom commented 7 years ago

Please try the newer version.