search

RuckusWirelessIL / pentaho-kafka-consumer

Apache Kafka consumer step plug-in for Pentaho Kettle
Apache License 2.0
66 stars 40 forks source link

Kafka Consumer Step Question #18

Closed cbrathwaite closed 7 years ago

cbrathwaite commented 7 years ago

When I open the Kafka Consumer step and try to add a parameter, the changes do not persist after I close the step. This is on PDI 7, with the latest version of the steps. Is this by design? If not, is this a bug? I noticed the same issue with the Kafka Producer Step.

spektom commented 7 years ago

Can you see any exceptions in the log file? On Wed, Nov 16, 2016 at 00:38 Chantel Brathwaite notifications@github.com wrote:

When I open either the Kafka Consumer or Producer steps and try to add a parameter, the changes do not persist after I close the step. This is on PDI 7, with the latest version of the steps. Is this by design? If not, is this a bug?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/RuckusWirelessIL/pentaho-kafka-consumer/issues/18, or mute the thread https://github.com/notifications/unsubscribe-auth/AAJpO0NBzO90U7qyN2ZRp79s-VUkTUf8ks5q-jRrgaJpZM4KzHJt .

cbrathwaite commented 7 years ago

Hi!
Thanks for your response. The log looks pretty clean aside from non-kafka related errors and warnings. I'm including the log file at the end of this message so you have context. In this log, I had a transformation open that contained the Kafka Consumer step; I tried to add a new parameter and also to delete one. The changes did not persist when I closed the step and opened it again.

I reinstalled the marketplace plugin using the GUI. I did see a ConcurrentModification exception there, and it seemed to occur when I installed the plugin from the marketplace, but I've not yet had a chance to replicate. I will work on that and will report back.

I have a video that shows the error if you need it. I can upload it if you are interested, please let me know. Here are the replication steps:

  1. Start Spoon.
  2. Open a transformation.
  3. Add the Kafka Consumer step.
  4. Open the step and add a new parameter.
  5. Click OK to close the step.
  6. Reopen the step. Note that the new parameter does not appear.
  7. Delete a parameter.
  8. Click OK to close the step.
  9. Reopen the step. Note that the deleted parameter reappears.
  10. Edit one of the existing values.
  11. Close the step.
  12. Reopen the step. Note that the edited value persists.

So, it seems that the user cannot update the parameter. My main question for you is whether this behavior is by design or not. The Kafka Producer step shows the same behavior.

Here are the logs:

CLEAN LOG

C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration>"C:\Pentaho\Pentaho_70Wiz_GA\java\bin\java.exe" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=admin" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" -jar launcher\pentaho-application-launcher-7.0.0.0-25.jar -lib ..\libswt\win64 /level:Debug 09:05:47,530 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled 09:05:50,711 INFO [KarafInstance]

* Karaf Instance Number: 2 at C:\Pentaho\Pentaho_70Wiz_GA\design-tools\da * * ta-integration.\system\karaf\caches\spoon\data-1 * * Karaf Port:8803 * * OSGI Service Port:9052 *

Nov 16, 2016 9:05:55 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired INFO: Lock acquired. Setting startlevel to 100 2016/11/16 09:06:00 - General - Logging plugin type found with ID: CheckpointLogTable 2016/11/16 09:06:01 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp 2016-11-16 09:06:04 weka.gui.GenericObjectEditor registerEditors INFO: ---Registering Weka Editors--- 2016-11-16 09:06:06 weka.experiment.DatabaseUtils initialize WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH? 2016-11-16 09:06:06 weka.gui.beans.BeansProperties loadProperties INFO: [KnowledgeFlow] Loading properties and plugins... 2016-11-16 09:06:06 weka.gui.beans.KnowledgeFlowApp init INFO: [KnowledgeFlow] Initializing KF... 2016-11-16 09:06:09.904:INFO:oejs.Server:jetty-8.1.15.v20140411 2016-11-16 09:06:10.792:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9052 Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/ Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (180) [org.apache.cxf.management.InstrumentationManager] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (183) [org.apache.cxf.wsdl.WSDLManager] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (185) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (186) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (187) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (204) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (189) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver] Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (200) [org.apache.cxf.transport.local.LocalTransportFactory] Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (201) [org.apache.cxf.binding.object.ObjectBindingFactory] Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig# Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-securitypolicy/200702 Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (221) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader] Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (223) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener] Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (225) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader] Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (226) [org.apache.cxf.javascript.JavascriptServerListener] Nov 16, 2016 9:06:23 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess INFO: New Caching Service registered 2016-11-16 09:06:30 weka.gui.GenericObjectEditor registerEditors INFO: ---Registering Weka Editors--- 2016-11-16 09:06:33 weka.experiment.DatabaseUtils initialize WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH? 2016-11-16 09:06:33 weka.gui.beans.BeansProperties loadProperties INFO: [KnowledgeFlow] Loading properties and plugins... 2016-11-16 09:06:33 weka.gui.beans.KnowledgeFlowApp init INFO: [KnowledgeFlow] Initializing KF... 2016-11-16 09:06:40 weka.gui.GenericObjectEditor registerEditors INFO: ---Registering Weka Editors--- SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2016-11-16 09:06:44 weka.experiment.DatabaseUtils initialize WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH? 2016-11-16 09:06:44 weka.gui.beans.BeansProperties loadProperties INFO: [KnowledgeFlow] Loading properties and plugins... 2016-11-16 09:06:44 weka.gui.beans.KnowledgeFlowApp init INFO: [KnowledgeFlow] Initializing KF... Nov 16, 2016 9:06:48 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /lineage Nov 16, 2016 9:06:50 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /i18n Nov 16, 2016 9:06:53 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /marketplace 2016/11/16 09:06:56 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml 2016/11/16 09:06:57 - Spoon - Logging is at level : Debug 2016/11/16 09:07:04 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /det/core/data Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /det/pdi/navigation Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /det/pdi/repository Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination INFO: Setting the server's publish address to be /det/pdi/publish Attempting to load ESAPI.properties via file I/O. Attempting to load ESAPI.properties as resource file via file I/O. Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\ESAPI.properties Not found in SystemResource Directory/resourceDirectory: .esapi\ESAPI.properties Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\ESAPI.properties Loading ESAPI.properties via file I/O failed. Exception was: java.io.FileNotFoundException Attempting to load ESAPI.properties via the classpath. SUCCESSFULLY LOADED ESAPI.properties via the CLASSPATH from '/ (root)' using current thread context class loader! SecurityConfiguration for Validator.ConfigurationFile not found in ESAPI.properties. Using default: validation.properties Attempting to load validation.properties via file I/O. Attempting to load validation.properties as resource file via file I/O. Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\validation.properties Not found in SystemResource Directory/resourceDirectory: .esapi\validation.properties Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\validation.properties Loading validation.properties via file I/O failed. Attempting to load validation.properties via the classpath. validation.properties could not be loaded by any means. fail. Exception was: java.lang.IllegalArgumentException: Failed to load ESAPI.properties as a classloader resource. SecurityConfiguration for Logger.LogServerIP not either "true" or "false" in ESAPI.properties. Using default: true 2016/11/16 09:08:37 - Spoon - Spoon has ended. stopping Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0

CONCURRENT MODIFICATION ISSUE

Please note that I am working on replicating this to verify whether this is directly related to the two Kafka plugins. I will report back as soon as I have more information.

INFO: Setting the server's publish address to be /det/pdi/publish 2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Error initializing transformation 2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : java.util.ConcurrentModificationException 2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.checkForComodification(Unknown Source) 2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.next(Unknown Source) 2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.applyPluginsForContainer(SpoonPluginManager.java:130) 2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:870) 2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:9256) 2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.create(Window.java:426) 2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.open(Window.java:785) 2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9287) 2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685) 2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) 2016/11/16 08:51:25 - General - at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) 2016/11/16 08:51:25 - General - at java.lang.reflect.Method.invoke(Unknown Source) 2016/11/16 08:51:25 - General - at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92) 2016/11/16 08:51:49 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp 08:53:50,468 ERROR [AbstractXulDomContainer] Error invoking method: spoon.newTransFile() java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402) at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source) at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source) at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359) at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92) Caused by: java.lang.NullPointerException at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265) at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298) at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029) at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021) at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760) ... 27 more 08:53:50,480 ERROR [AbstractXulComponent] Error calling oncommand event org.pentaho.ui.xul.XulException: Error invoking method: spoon.newTransFile() at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:317) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402) at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source) at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source) at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359) at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313) ... 22 more Caused by: java.lang.NullPointerException at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265) at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298) at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029) at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021) at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760) ... 27 more 2016/11/16 08:54:05 - Spoon - Spoon has ended.

cbrathwaite commented 7 years ago

NOTE: I made a quick change to the title since my questions focus on the Kafka Consumer step. (The replication path does as well.) But this same behavior seems to be in the Kafka Producer step as well.

Also, the concurrent modification issue was not related to your plugin. Please disregard that error message.

Finally, the video that shows how this was set up, etc. is here: https://github.com/cbrathwaite/cbrathwaite.

Thanks!

Chantel