logstash-plugins / logstash-filter-jdbc_static

Loads a DB query's result set in memory and uses it as lookup table for events.
Apache License 2.0
11 stars 12 forks source link

Unexpected exception #30

Closed paulkeogh closed 6 years ago

paulkeogh commented 6 years ago

LS 6.2.4

My loader query tries to load a table of ~8000 rows but throws an error of;

[2018-05-31T21:29:51,482][ERROR][logstash.filters.jdbc.readwritedatabase] Exception when filling lookup db from loader query results, original exception: Java::JavaSql::SQLNonTransientConnectionException, original message: No current connection. {:backtrace=>["org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.Util.generateCsSQLException(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.Util.generateCsSQLException(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.Util.noCurrentConnection(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.EmbedConnection.checkIfClosed(org/apache/derby/impl/jdbc/EmbedConnection)", "org.apache.derby.impl.jdbc.EmbedConnection.setAutoCommit(org/apache/derby/impl/jdbc/EmbedConnection)", "java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:498)"....

If I limit the loader query to 2000 rows, it works fine !

Query is simple;

select x, y, x from schema.table order by x limit 0,2000

Any ideas ?

MikeKemmerer commented 6 years ago

Hi Paul,

Try updating the plugin. I'm still on 6.2.3 but had to update the plugin for it to be the latest version that would pull in all my records successfully.

Mike


Michael Kemmerer

On Thu, May 31, 2018 at 1:35 PM, Paul Keogh notifications@github.com wrote:

LS 6.2.4

My loader query tries to load a table of ~8000 rows but throws an error of;

[2018-05-31T21:29:51,482][ERROR][logstash.filters.jdbc.readwritedatabase] Exception when filling lookup db from loader query results, original exception: Java::JavaSql::SQLNonTransientConnectionException, original message: No current connection. {:backtrace=>["org.apache.derby.impl.jdbc. SQLExceptionFactory.getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.SQLExceptionFactory. getSQLException(org/apache/derby/impl/jdbc/SQLExceptionFactory)", "org.apache.derby.impl.jdbc.Util.generateCsSQLException( org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc. Util.generateCsSQLException(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.Util.noCurrentConnection(org/apache/derby/impl/jdbc/Util)", "org.apache.derby.impl.jdbc.EmbedConnection.checkIfClosed( org/apache/derby/impl/jdbc/EmbedConnection)", "org.apache.derby.impl.jdbc. EmbedConnection.setAutoCommit(org/apache/derby/impl/jdbc/EmbedConnection)", "java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:498)"....

If I limit the loader query to 2000 rows, it works fine !

Query is simple;

select x, y, x from schema.table order by x limit 0,2000

Any ideas ?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/logstash-plugins/logstash-filter-jdbc_static/issues/30, or mute the thread https://github.com/notifications/unsubscribe-auth/AJuwfUgVRAa-f4uz7TyPs3XbrlbatF0qks5t4FQqgaJpZM4UVseY .

paulkeogh commented 6 years ago

Thanks for the suggestion Mike. Upgrading from 1.0.1 to 1.0.3 solved the issue.