Closed JerseyGood closed 4 years ago
Hi @JerseyGood loading of drivers has changed recently, please could you try with 4.3.18 version and report here if the problem persists?
@andsel Thanks for the reply, will give it a try with 4.3.18 of jdbc-input-plugin and share the result.
But we are installing Logstash through apt
and the latest stable version logstash is 1:6.8.4-1
which I believe by default uses jdbc-input-plugin 4.3.16
https://www.elastic.co/guide/en/logstash/6.8/logstash-6-8-4.html
Do you know when will logstash bump up the version to use jdbc-input-plugin 4.3.18
I've run into a very similar-looking problem with Logstash 7.4, installed on Ubuntu 18.0.4 with the "apt-get" instructions listed here: https://www.elastic.co/guide/en/logstash/current/installing-logstash.html
$ echo "deb https://artifacts.elastic.co/packages/7.x/apt stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list
$ sudo apt-get update && sudo apt-get install logstash
$ /usr/share/logstash/bin/logstash --version
logstash 7.4.2
Trying to connect to a MySQL database with the JDBC connector mysql-connector-java-8.0.18.jar
, Logstash just kept failing with plugin loading errors. But this error went away when I updated the logstash-input-jdbc
plugin:
$ sudo /usr/share/logstash/bin/logstash-plugin update logstash-input-jdbc
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.headius.backport9.modules.Modules to method java.lang.Object.finalize()
WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Updating logstash-input-jdbc
Updated logstash-input-jdbc 4.3.16 to 4.3.18
This is a very tricky problem to diagnose! 4.3.18 should be made the default plugin version ASAP, to avoid this bug, AFAICS.
I can confirm this is fixed with logstash 6.8.5
This was fixed by #355 and is fixed by the latest release of the jdbc input.
Running bin/logstash-plugin update logstash-input-jdbc
should get you to 4.3.19 (this fix landed in 4.3.18):
/tmp/logstash-7.5.0
❯ bin/logstash-plugin update logstash-input-jdbc
Updating logstash-input-jdbc
Updated logstash-input-jdbc 4.3.16 to 4.3.19
Version >=4.3.19 will be shipped in 7.5.1
The latest release of Logstash 6.8.4 with jdbc-input-plugin 4.3.16 give us following error in syslog
our pipeline config looks like
OS Info
JDK info
It was fine when running Logstash 6.8.2 and 6.8.3 with jdbc-input-plugin 4.3.13. So I guess something wrong with the Driver loading modification for jdbc-input-plugin 4.3.14. and 4.3.15 release
A workaround for us is to not using jdbc_driver_library but place the ojdbc6.jar in logstash-core lib path