search

ngless-toolkit / ngless

NGLess: NGS with less work
https://ngless.embl.de
Other
142 stars 24 forks source link

Decrease memory usage of count() with seqname #57

Closed luispedro closed 6 years ago

luispedro commented 6 years ago

Currently, the code uses a sorted Vector InfoRef where InfoRef is

data InfoRef = InfoRef {-# UNPACK #-} !ShortByteString {-# UNPACK #-} !Double

but this has a lot of memory overhead compared to something like a C++ std::vector<std::pair<const char*, double>> where the string data is packed together.

This could easily be done as a generic Haskell library independent of any NGLess code.

luispedro commented 6 years ago

This has been addressed in NGLess 0.7