search

attic-labs / noms

The versioned, forkable, syncable database
Apache License 2.0
7.45k stars 266 forks source link

csv-invert: Perf improvments! #3698

Closed cmasone-attic closed 6 years ago

cmasone-attic commented 6 years ago

Tweaking the main loop that processes list entries to avoid some map assignments, lookups, and allocations saves 15% or so, resulting in an overall savings of about 1m on the 6m runtime of our test workload (as run on my laptop).

Towards #3690

cmasone-attic commented 6 years ago

PTAL

cmasone-attic commented 6 years ago

well, the win will be less, now, that the sequence_chunker.go change is put off to another patch. But, still we should get about a 15% improvement