mozilla-services / hindsight

Hindsight - light weight data processing skeleton
Mozilla Public License 2.0
665 stars 55 forks source link

Async output checkpoints are only updated when consuming data #190

Closed trink closed 5 years ago

trink commented 5 years ago

If an output plugin matches a message for async output and properly acknowledges it and then never matches another message the checkpoint will not advanced for the data it is skipping, eventually back pressuring the system.

See: https://github.com/mozilla-services/lua_sandbox_extensions/issues/444