fix(server/pandas): reindex rows at the end of rollup step (TCTC-8689)

ToucanToco / weaverbird

A visual data pipeline builder with various backends

https://weaverbird.toucantoco.dev

BSD 3-Clause "New" or "Revised" License

97 stars 17 forks source link

fix(server/pandas): reindex rows at the end of rollup step (TCTC-8689) #2177

Closed julien-pinchelimouroux closed 3 months ago

julien-pinchelimouroux commented 3 months ago

Why

Can raise *** ValueError: cannot reindex on an axis with duplicate labels if the next step assigns a new column

julien-pinchelimouroux commented 3 months ago

@davinov If the rollup has multiple columns configured, it will always creates duplicates indexes We can at least check on this condition before apply the index re-computation