search

velvia / compressed-vec

SIMD Floating point and integer compressed vector library
Apache License 2.0
78 stars 8 forks source link

Construct from compressed bytes #8

Open ccollie opened 4 days ago

ccollie commented 4 days ago

I'm looking at this library for one of my projects, and one requirement is periodic sync of vectors to storage. We have.finish(), but we don't have a constructor which takes in the compressed bytes. I currently construct a reader then populate an empty vector from the iterator. This seems wasteful.

Also, would it be possible to add a non-consuming finish_into(&mut buf)? Right now I have to clone a vector in order to sync it.

ccollie commented 4 days ago

I should clarify that I specifically want to write out the data from an appender which is used for data ingest.