logstash-input-kafkafile - Read a file into Logstash provided by a kafka message

[thehybridtechnician]

https://github.com/thehybridtechnician/logstash-input-kafkafile

We wrote this plugin to deal with whole file ingestion controlled via kafka. It has been very beneficial for us in our environments over the last year so I hope it helps.

I would not say I am a developer so I could definitely use help from the community to make it better.

I am learning rspec and will be adding tests but wanted to get this out to the community. Thank you!

[suyograo]

I am not very sure about the name of this plugin though..

@acchen97 thoughts?

[suyograo]

From the description, I actually thought you are reading directly from kafka log files on disk

[thehybridtechnician]

@suyograo - I can always change the name and I will improve the description.