Azure-Samples / contoso-chat

This sample has the full End2End process of creating RAG application with Prompt Flow and AI Studio. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.
MIT License
366 stars 2.28k forks source link

Deployment chat-deployment-1718994551 not found in endpoint #139

Open dbfuns opened 1 week ago

dbfuns commented 1 week ago

Trying to deploy service chat but keep getting the following error:

RESPONSE 404: 404 Not Found ERROR CODE: UserError

{ "error": { "code": "UserError", "message": "Deployment chat-deployment-1718994551 not found in endpoint mloe-eqs2edvbximzo, workspace ai-project-eqs2edvbximzo", "details": [],

  {
    "type": "MessageParameters",
    "info": {
      "value": {
        "deploymentName": "chat-deployment-1718994551",
        "endpointName": "mloe-eqs2edvbximzo",
        "workspaceName": "ai-project-eqs2edvbximzo"
      }
    }
  }

However, I checked the azure portal and I can see the deployment succeeded.

image

nitya commented 1 week ago

Thanks for reporting this @dbfuns -- I have reproduced this error and have reported it for resolution. The issue appears to be a timing related one on the azd side (azd shows a failure message but portal does complete deployment)

The issue does however create a problem on the server where testing the deployed endpoint will fail because the default Traffic allocation is now set at 0% (likely due to that error). Manually updating the allocation to 100% gets you a workaround for now but will leave this issue open until I have got a resolution for the original User Error.

nitya commented 6 days ago

Issue has been file with on azure-dev repo for resolution. Will update here when status changes.