search

jamesmcroft / bicep-templates

A centralized resource for providing baseline templates for building and deploying infrastructure-as-code best practices using Azure Bicep
MIT License
2 stars 1 forks source link

List of endpoints for an Azure AI Services resource #1

Closed georgekosmidis closed 1 week ago

georgekosmidis commented 1 week ago

Hello James!

Loved your repo, but i have one question!

In the following snippet: https://github.com/jamesmcroft/bicep-templates/blob/f711de7f1081b18d1bc707649c8c59b3ce9fc473/ai_ml/ai-services.bicep#L299, you are using 'OpenAI Language Model Instance API' as an index for the endpoints array. Where did you find that? is there a list of these items somewhere?

I deployed an Azure AI services resource with bicep, and I need add to an Azure Function App i am deploying, environment variables towards the various endpoints.

Do you know where i can find that list?

Thank you! George

jamesmcroft commented 1 week ago

@georgekosmidis thanks for reaching out.

These endpoints aren't well documented now, but I can provide the current list. FYI, if you want to view these, you can find them in the Resource JSON for the Azure AI Service under the same endpoints property.

It's important to note though, many of these AI services use the same https://<your-resource>.cognitiveservices.azure.com URL. Whereas the OpenAI specific endpoints provide the Azure OpenAI URL https://<your-resource>.openai.azure.com.

In general, you can use the endpoint property of the AI Service which is the cognitiveservices.azure.com URL.

georgekosmidis commented 1 week ago

Really appreciate your fast response! I end up using output aiServiceEndpoints string = string(aiServices.properties.endpoints)

That returned the following list:

{
  "OpenAI Language Model Instance API": "https://swedencentral.api.cognitive.microsoft.com/",
  "OpenAI Dall-E API": "https://swedencentral.api.cognitive.microsoft.com/",
  "OpenAI Whisper API": "https://swedencentral.api.cognitive.microsoft.com/",
  "OpenAI Model Scaleset API": "https://swedencentral.api.cognitive.microsoft.com/",
  "Token Service API": "https://swedencentral.api.cognitive.microsoft.com/",
  "Content Safety": "https://swedencentral.api.cognitive.microsoft.com/",
  "Container": "https://swedencentral.api.cognitive.microsoft.com/",
  "Computer Vision": "https://swedencentral.api.cognitive.microsoft.com/",
  "FormRecognizer": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speech to Text": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speech to Text v3.2": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speech to Text 2024-05-15-preview": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speech to Text v3.2_internal.1": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Custom Voice": "https://swedencentral.api.cognitive.microsoft.com/",
  "Video Translation": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Audio Content Creation": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Custom Avatar": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Batch Avatar": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Batch Text to Speech": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speech to Text (Standard)": "https://swedencentral.stt.speech.microsoft.com",
  "Speech Services Text to Speech (Neural)": "https://swedencentral.tts.speech.microsoft.com",
  "Speech Services Speaker Verification": "https://swedencentral.api.cognitive.microsoft.com/",
  "Speech Services Speaker Identification": "https://swedencentral.api.cognitive.microsoft.com/",
  "Token": "https://swedencentral.api.cognitive.microsoft.com/",
  "Text Analytics": "https://swedencentral.api.cognitive.microsoft.com/",
  "Custom Text Authoring": "https://swedencentral.api.cognitive.microsoft.com/",
  "Conversational Language Understanding Authoring": "https://swedencentral.api.cognitive.microsoft.com/",
  "Custom Question Answering Authoring": "https://swedencentral.api.cognitive.microsoft.com/",
  "Custom Question Answering": "https://swedencentral.api.cognitive.microsoft.com/",
  "ConversationalLURuntime": "https://swedencentral.api.cognitive.microsoft.com/",
  "Language": "https://swedencentral.api.cognitive.microsoft.com/",
  "QnAMaker": "https://swedencentral.api.cognitive.microsoft.com/",
  "Turing": "https://swedencentral.api.cognitive.microsoft.com/",
  "QuestionAnswering": "https://swedencentral.api.cognitive.microsoft.com/",
  "LUIS": "https://swedencentral.api.cognitive.microsoft.com/",
  "TextTranslation-Global": "https://api.cognitive.microsofttranslator.com/",
  "TextTranslation": "https://swedencentral.api.cognitive.microsoft.com/",
  "DocumentTranslation": "https://swedencentral.api.cognitive.microsoft.com/"
}

That was not what I was expecting! This is usually the common base URL that you can also get from aiServices.properties.endpoint.

What I was looking for was the endpoint including the path, something like the following list:

Thank you :)