search

apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.25k stars 1.23k forks source link

Upsert Compaction: CRC mismatch robustness #13493

Open tibrewalpratik17 opened 6 days ago

tibrewalpratik17 commented 6 days ago

This issue of CRC mismatches across replicas for a segment has been discussed multiple times (https://github.com/apache/pinot/issues/12396, https://github.com/apache/pinot/issues/11004). I'm creating this parent issue to track how these mismatches affect the Upsert compaction flow overall. While eliminating CRC mismatches entirely would be ideal, until we find the best solution for that, we can focus on making the Upsert compaction flow robust enough to handle such mismatches.

hpvd commented 4 days ago

you could add new parent-issue label