Proper use of binlogger

ModaOperandi / agora

Engineering standards

3 stars 1 forks source link

Closed rlmartin closed 4 years ago

rlmartin commented 4 years ago

How is the data exposed and how do we manage change?

Foundation: binlogger provides the stream of source data, to be used to build a local projection of that data.

Initial thoughts (without PoCs around performance)

Local projection should remain just that: local, i.e. only one consumer of that projection.
If there is more than one consumer of that projection, it should be behind an API

rlmartin commented 4 years ago

How do we distribute ownership of this? Core Services squad (unlikely financially)? A Core Services Guild? Who responds to alerts?

Need to support DDL events.

Scala Steward to update Scala dependencies.

Better support for high-volume of events.

ECS machines need to be upgraded. Switch to Fargate?

rlmartin commented 4 years ago

Check with Data Eng squad on their usage and products they're building on top of it.

rlmartin commented 4 years ago

Potentially can discuss two weeks from now.