DeSerialization of PHMAP takes ∞

dib-lab / kProcessor

kProcessor: kmers processing framework.

https://kprocessor.readthedocs.io

BSD 3-Clause "New" or "Revised" License

11 stars 1 forks source link

Closed mr-eyes closed 4 years ago

mr-eyes commented 4 years ago

cereal deserialization of very large hashmaps takes much time.

Deserializing PHMAP containing 172670656 kmers took about 40 mins.

mr-eyes commented 4 years ago

Deserializing 172 Million kmers took about 40 mins to complete.

mr-eyes commented 4 years ago

Solved in this commit

Loading time now is 2 seconds.