search

KazooHR / engineering-lunchnlearn

A place for tracking things we talk about, or want to talk about, at Lunch 'n' Learn.
1 stars 0 forks source link

Change Streams in MongoDB 3.6+ #14

Open stripethree opened 5 years ago

stripethree commented 5 years ago

Issue by benkimball Friday Sep 28, 2018 at 20:21 GMT Originally opened as https://github.com/youearnedit/YEI-lunchnlearn/issues/9

Change Streams are a feature introduced in MongoDB 3.6 which allow clients to subscribe to filtered updates from the database. The functionality is similar to tailing the oplog, but without the downsides of using a private and undocumented API. I am exploring change streams to see if we can use them to solve some of our thornier reporting performance problems, by tracking things like recognitions in "soft" realtime and incrementing counts and values in dedicated collections.

stripethree commented 5 years ago

Comment by stripethree Tuesday Oct 09, 2018 at 13:52 GMT

Suggestion, though previewing it, it looks a little dry... https://www.youtube.com/watch?v=ZkdxrD0_OnA

Maybe better? https://www.youtube.com/watch?v=eBGC6z1fPs0

stripethree commented 5 years ago

Comment by tastypackets Tuesday Jul 02, 2019 at 17:20 GMT

Suggestion, though previewing it, it looks a little dry... https://www.youtube.com/watch?v=ZkdxrD0_OnA

Maybe better? https://www.youtube.com/watch?v=eBGC6z1fPs0

I actually saw this talk in person!

Anyway I have worked with change streams in production, I know some of the pitfalls and upsides. If at some point you want to move forward with this talk I would be glad to help out and provide a few extra tips. 😄