dotmesh-io / dotmesh

dotmesh (dm) is like git for your data volumes (databases, files etc) in Docker and Kubernetes
https://dotmesh.com
Apache License 2.0
539 stars 29 forks source link

Route diff response through internal pubsub instead of NATS #691

Open rusenask opened 5 years ago

rusenask commented 5 years ago

Refactor pubsub into a separate package that can:

This is to ensure that when doing things locally, we can safely send messages that are larger than message queue limits.

See also https://github.com/dotmesh-io/local-stack/issues/12

Note that this issue only manifests when have a lot of files

lukemarsden commented 5 years ago

workaround here for now: https://github.com/dotmesh-io/dotmesh/pull/692

alaric-dotmesh commented 5 years ago

Please add more detail @rusenask