dotnet / aspire

Tools, templates, and packages to accelerate building observable, production-ready apps
https://learn.microsoft.com/dotnet/aspire
MIT License
3.91k stars 475 forks source link

Add AI Model Catalog Aspire Component #2189

Open luisquintanilla opened 9 months ago

luisquintanilla commented 9 months ago

Currently, Aspire supports connecting to OpenAI / Azure OpenAI services.

Add component to support different AI model providers such as those provided by the Azure AI Studio Model Catalog

Semantic Kernel is currently working on Connectors for model providers like the Azure AI Model Catalog

https://devblogs.microsoft.com/semantic-kernel/spring-2024-roadmap-for-semantic-kernel/

Consider leveraging the work Semantic Kernel is doing to configure and expose these model services through Aspire.

luisquintanilla commented 3 months ago

Aspire Components

  1. Provision Azure ML infrastructure.
    • Azure ML Workspace. The Azure ML Workspace provisions additional resources such as:
      • Key Vault
      • Log Analytics
  2. Deploys serverless API endpoint.