search

mlcommons / ck

Collective Knowledge (CK) is an educational community project to learn how to run AI, ML and other emerging workloads in the most efficient and cost-effective way across diverse models, data sets, software and hardware using MLCommons CM (Collective Mind workflow automation framework)
https://cKnowledge.org
Apache License 2.0
607 stars 114 forks source link

Download stable CM repositories from Zenodo or other permanent archives #592

Closed gfursin closed 9 months ago

gfursin commented 1 year ago

Add/check support to download stable CM repositories from permanent archives.

gfursin commented 1 year ago

This will be useful for our Artifact Evaluation and Reproducibility initiatives at some ACM and IEEE conferences in 2023!

gfursin commented 9 months ago

This functionality is available in the latest CM 1.6.0 release. I am testing it now ...

gfursin commented 9 months ago

Uploaded a snapshot of reusable automation recipes (CM scripts) (< 3 MB) to Zenodo. It is possible to download such snapshot as follows:

cm pull repo --url=https://zenodo.org/records/10576423/files/cm-mlops-repo.zip
gfursin commented 9 months ago

This will be useful to ensure reproducibility of CM MLPerf workflows (though the GitHub repositories and PIP packages may still fail but that's an extra issue that we are solving with our high-levle dependency management and reporting all versions) ...