qiime2 / q2cli

Command line interface for QIIME 2
BSD 3-Clause "New" or "Revised" License
19 stars 24 forks source link

enable direct-to-cache imports #317

Closed gregcaporaso closed 10 months ago

gregcaporaso commented 11 months ago

To speed up import of very large data sets, we should be able to directly import data (e.g., a collection of fastq.gz files) to an artifact cache, without going through an Archive (.qza). This would avoid the zipping of the large dataset.

Oddant1 commented 11 months ago

I moved this to the cli because this is actually totally possible in the Python API by doing the following:

cache = Cache(path)

art = Artifact.import_data(type, view)
cache.save(art)
ebolyen commented 10 months ago

@Oddant1, I created another issue for a slightly different problem: https://github.com/qiime2/qiime2/issues/730