mlcommons / cm4mlops

A collection of portable, reusable and cross-platform automation recipes (CM scripts) to make it easier to build and benchmark AI systems across diverse models, data sets, software and hardware
http://docs.mlcommons.org/cm4mlops/
Apache License 2.0
13 stars 20 forks source link
automation cross-platform devops machine-learning mlops mlperf reusable workflow workflow-automation

Unified and cross-platform CM interface for DevOps, MLOps and MLPerf

License Python Version Powered by CM. Downloads

CM script automation features test MLPerf inference bert (deepsparse, tf, onnxruntime, pytorch) MLPerf inference MLCommons C++ ResNet50 MLPerf inference ABTF POC Test Test Compilation of QAIC Compute SDK (build LLVM from src) Test QAIC Software kit Compilation

Please see the docs site for understanding CM scripts better. The mlperf-branch of the cm4mlops repository contains updated CM scripts specifically for MLPerf Inference. For more information on using CM for MLPerf Inference, visit the MLPerf Inference Documentation site.

News

License

Apache 2.0

CM concepts

Check our ACM REP'23 keynote.

Authors

Grigori Fursin and Arjun Suresh

Major script developers

Arjun Suresh, Anandhu S, Grigori Fursin

Funding

We thank cKnowledge.org, cTuning foundation and MLCommons for sponsoring this project!

Acknowledgments

We thank all volunteers, collaborators and contributors for their support, fruitful discussions, and useful feedback!