logv / sybil

columnar storage + NoSQL OLAP engine | https://logv.org
https://logv.org
Other
305 stars 26 forks source link

speed up ResetRecords for tables with large number of columns #115

Closed okayzed closed 4 years ago

okayzed commented 4 years ago

For tables with hundreds / thousands of columns, we can speed up ResetRecords when recycling slabs.

For tables with < 100 fields, this won't have much effect, but on the jaeger table, it takes query time for 27mm from 14s -> 8s by running memclr in larger chunks and on less data.