vatlab / varianttools

software tool for the manipulation, annotation, selection, and analysis of variants in the context of next-gen sequencing analysis
https://vatlab.github.io/vat-docs/
GNU General Public License v3.0
31 stars 4 forks source link

Faster access to HDF5 using vaex #112

Open BoPeng opened 5 years ago

BoPeng commented 5 years ago

Interesting talk at SciPy 2019, vaex acts on HDF5 files (that we use) but does the filtering and computation extremely fast with minimal memory usage (use memory map heavily).

The library is at https://github.com/vaexio/vaex

BoPeng commented 5 years ago

This could significantly improve the performance of our vtools update operation on statistics, and filtering operations for vtools associate.