search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
69 stars 3.5k forks source link

New plugin logstash-input-mongodb #2836

Open phutchins opened 9 years ago

phutchins commented 9 years ago

I've create an input plugin for mongodb and would like to contribute it to the plugin repository. It currently fits my needs and I'm working with a couple of interested parties that found my plugin on github to make it usable for them and ideally anyone else that would want to move log data, or any data from mongodb through logstash.

I'd like for it to be reviewed in it's current state and to gather input. I will begin to write tests for it shortly. Also, I'm curious about the use of JRuby which the jdbc/sqlite3 gem requires. Does logstash always run on JRuby or should I bother making this run in any ruby?

Repo: https://github.com/phutchins/logstash-input-mongodb

suyograo commented 9 years ago

@phutchins thanks for your contribution! The team is currently busy with the final blockers for 1.5.0 -- we will review the mongodb input soon after. Our general advice to is to run Logstash on JVM in production. Also, some plugins like Kafka only work on JVM today, so this should be ok. We do intend to support MRI as an option for 2.0, and will be working on it. So for now, you can focus only on JRuby.

suyograo commented 9 years ago

@phutchins +1 for integration and unit tests

phutchins commented 8 years ago

Just wanted to give an update. I've gone through most of the github issues and am working to clean up the docs. Also will be finding time to implement pulling from the oplog. And of course, I need to beef up the tests...