Blog: Journey Series for Generative AI Application Architecture - Fine-tune SLM with Microsoft Olive

[konabuta]

Journey Series for Generative AI Application Architecture - Fine-tune SLM with Microsoft Olive

Link: https://techcommunity.microsoft.com/t5/educator-developer-blog/journey-series-for-generative-ai-application-architecture-fine/ba-p/4080813

My understanding was that Olive was a tool for inference optimization. But ... looks like they also suport fine-tuning process? I want to check the details.

[konabuta]

2. A?ll models on Azure need to be set to PyTorch.MLflow

... Why?

[konabuta]

Architecture

[konabuta]

PyTorch model

Reference: https://microsoft.github.io/Olive/features/passes/pytorch.html

• LoRA
• QLoRA
• LoftQ
• SparseGPT
• TorchTRTConversion