phutchins / logstash-input-mongodb

MongoDB input plugin for Logstash
Other
187 stars 104 forks source link

Tail Mongo Oplog #18

Open gairom opened 9 years ago

gairom commented 9 years ago

Hi, Is there any plans to implement tailing the Mongo oplog in order to pickup changes to existing docs?

gairom commented 9 years ago

maybe somehow combine this with this plugin: https://github.com/stripe/mongoriver

phutchins commented 8 years ago

Actually, I would love to implement this. This is a great use case for this plugin. It might even be well suited as the default behavior.

I'll look into what this would take. Feel free to add any ideas or thoughts...

marcinkubica commented 8 years ago

Hi, defo this feature will make your plugin complete! it takes months already for mongodb team to upgrade their connector to support ES 2.x and frankly thats a little too long. +100

phutchins commented 8 years ago

Just an update... Haven't lost sight of this. Just been busy over the holidays. Plan on attacking this one soon. Help in the form of PR's is always welcome :).

If anyone is good with writing tests, that would be a huge help to the plugin...

phutchins commented 8 years ago

Just an update but this is one of the next tasks on my list. Hope to tackle soon...

puneetjindal commented 8 years ago

I am eager to use this feature for my problem set!

CibilanJames commented 8 years ago

Waiting for this feature, An other alternate method to get updated documents from mongo