serverless / event-gateway

React to any event with serverless functions across clouds
https://www.serverless.com/event-gateway
Apache License 2.0
1.65k stars 97 forks source link

Event persistance #369

Open mthenw opened 6 years ago

mthenw commented 6 years ago

I'm creating this issue to have one place where we can track efforts related to events persistance.

EG doesn't persist events, it's just a router but there are definitely use cases where we would like to persist events in some persistent store (DB, S3 Kafka) to be able to analyze them or event replay.

Persisting events is right now doable with creating plugin that will listen to gateway.event.received and send them somewhere. There is lack of examples and tutorials though.

TODO:

cc @alexdebrie

alexdebrie commented 6 years ago

@mthenw I like this idea. Some follow-up questions:

1) Do plugins work on a space-by-space basis, or on the Event Gateway as a whole? If the latter, is a plugin the right mechanism? Different spaces may want to have different persistence policies.

2) Could this be solved by #357 and related PRs to add additional providers (Kafka, Firehose, maybe databases)? This would allow users to add persistence via an additional subscription.