first attempt to change from csv to parquet

bigbio / pmultiqc

A library for QC report based on MultiQC framework

GNU General Public License v3.0

14 stars 9 forks source link

first attempt to change from csv to parquet #97

Closed ypriverol closed 4 months ago

ypriverol commented 4 months ago

This PR will change pmultiqc to go from csv files into parquet files for the mzml statistics. This aims to reduce space in the quantms workflow. Related issue https://github.com/bigbio/quantms/issues/390 and PR https://github.com/bigbio/quantms/pull/391

jpfeuffer commented 4 months ago

By the way, if you care about absolute compression you could play around with compression levels and methods of parquet. But default is fine for the beginning.

ypriverol commented 4 months ago

Still dealing with another problem in Multiqc 1.23.