search

theangryangel / logstash-output-jdbc

JDBC output for Logstash
MIT License
256 stars 101 forks source link

With csv input first records is missed, this is not the case with elastic #112

Closed rkhapre closed 6 years ago

rkhapre commented 6 years ago

Hi

In a csv file i have 300 records, when i insert in database of Oracle, it gives me 299 records only. The first records is missed every time. I am using file input plugin

With exact same configuration when i post to elastic, it works perfectly ( 300 records)

Note :

  1. In my csv file i have new line in the last line
  2. I clear sincedb path before i run it.
  3. It works perfectly with elastic as output

Regards,Ritesh

theangryangel commented 6 years ago

The output plugin processes whatever it’s given by input/filters. It has no filtering/skipping mechanism built into it. The only reason it would fail on a row is if your statement fails. But if this did happen it would output a log entry saying why. This is not a bug with the output plugin.

Sent from my iPhone

On 4 Feb 2018, at 13:02, rkhapre notifications@github.com wrote:

Hi

In a csv file i have 300 records, when i insert in database of Oracle, it gives me 299 records only. The first records is missed every time. I am using file input plugin

With exact same configuration when i post to elastic, it works perfectly ( 300 records)

Note :

In my csv file i have new line in the last line I clear sincedb path before i run it. It works perfectly with elastic as output Regards,Ritesh

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

rkhapre commented 6 years ago

Okay i got it. let me debug more