deordie / deordie-digest

Data Engineering Digest
https://digest.deordie.org
Creative Commons Attribution 4.0 International
27 stars 2 forks source link

Designing a Production-Ready Kappa Architecture for Timely Data Stream Processing / Uber #1

Closed DashaBulanova closed 3 years ago

DashaBulanova commented 3 years ago

https://eng.uber.com/kappa-architecture-data-stream-processing/

Key takeaway: Out-of-order data is a big problem that can be mitigated but in some cases, it should be totally resolved. Usually, it resolved by using lambda architecture. Uber proposes their approach how to handle this problem in kappa architecture.

Ceridan commented 3 years ago

Published in Digest #3.