[CK2/CM scripts] discuss and unify how to reinstall/rebuild packages

mlcommons / ck

Collective Knowledge (CK) is an educational community project to learn how to run AI, ML and other emerging workloads in the most efficient and cost-effective way across diverse models, data sets, software and hardware using MLCommons CM (Collective Mind workflow automation framework)

https://cKnowledge.org

Apache License 2.0

606 stars 113 forks source link

[CK2/CM scripts] discuss and unify how to reinstall/rebuild packages #238

Closed gfursin closed 2 weeks ago

gfursin commented 2 years ago

Installation of packages often requires multiple steps:

clone/download sources
configure
build
install

If it fails, we want to be able to restart such CM scripts from any stage. Can we unify it?

arjunsuresh commented 2 years ago

Can we use a universal clone script which can be used as a prehook_dependency to do git clone? Similarly we can use a universal configure and build scrips as posthook_dependency. We need to decide how the results of such universal scrips can be cached.

gfursin commented 2 weeks ago

Should move to cm4mlops .