search

bacpop / ska.rust

Split k-mer analysis – version 2
https://docs.rs/ska/latest/ska/
Apache License 2.0
56 stars 4 forks source link

Partial loading of skf #22

Closed johnlees closed 12 months ago

johnlees commented 1 year ago

If the skf is very large, loading and decompressing the whole thing is slow. It might be possible just to define and get a header struct, which would be useful for ska nk.

johnlees commented 1 year ago

Could try #[serde(skip_deserializing)] on variants fields

johnlees commented 12 months ago

Tried skip_deserialising trait, and making a smaller struct which omits the large fields. Both take just as long to read in. It's possible this is due to either the CBOR format used (I think more likely) or the compression, but either way this would require a breaking change to the .skf format to work. I've got a couple of thoughts about that, but I will track them in #17 instead.