[Feature] AI toolchain operator add-on (KAITO)

Azure / AKS

Azure Kubernetes Service

https://azure.github.io/AKS/

1.97k stars 306 forks source link

[Feature] AI toolchain operator add-on (KAITO) #3976

Open sdesai345 opened 1 year ago

sdesai345 commented 1 year ago

Kubernetes operator to fully automate provisioning GPU SKUs, installing required plugins, and deploying an AI/ML inference service against selective OSS models. (#3976)

sdesai345 commented 2 months ago

Coming soon:

Support for model fine-tuning
Phi3 model family support
Azure Karpenter (NAP) integration
KAITO integration in AKS extension