Open JasonPowr opened 5 days ago
Description
Currently, Backfill-index reprocesses data that has already been indexed during previous runs. This leads to unnecessary processing and inefficiency.
Add a way to store the index of the last processed key so we only need to process new entries.
Description
Currently, Backfill-index reprocesses data that has already been indexed during previous runs. This leads to unnecessary processing and inefficiency.
Proposed Solution
Add a way to store the index of the last processed key so we only need to process new entries.