metagenomics / metagenomics-tk

GNU Affero General Public License v3.0
6 stars 1 forks source link

Improve pCollectFile implementation #355

Open pbelmann opened 7 months ago

pbelmann commented 7 months ago

If Csvtk is used with the subcommand "concat" then all files are stored in RAM which is the reason for using the highmem medium resource label. This could be improved by concatenating all files iteratively.