dotnet / aspire

An opinionated, cloud ready stack for building observable, production ready, distributed applications in .NET
https://learn.microsoft.com/dotnet/aspire
MIT License
3.63k stars 409 forks source link

Add AI Model Catalog Aspire Component #2189

Open luisquintanilla opened 7 months ago

luisquintanilla commented 7 months ago

Currently, Aspire supports connecting to OpenAI / Azure OpenAI services.

Add component to support different AI model providers such as those provided by the Azure AI Studio Model Catalog

Semantic Kernel is currently working on Connectors for model providers like the Azure AI Model Catalog

https://devblogs.microsoft.com/semantic-kernel/spring-2024-roadmap-for-semantic-kernel/

Consider leveraging the work Semantic Kernel is doing to configure and expose these model services through Aspire.

luisquintanilla commented 1 month ago

Aspire Components

  1. Provision Azure ML infrastructure.
    • Azure ML Workspace. The Azure ML Workspace provisions additional resources such as:
      • Key Vault
      • Log Analytics
  2. Deploys serverless API endpoint.