Azure / vscode-aks-tools

Visual Studio Code extension for Azure Kubernetes Service
MIT License
42 stars 52 forks source link

[KAITO VS Code Experience] #1070

Open davidgamero opened 1 week ago

davidgamero commented 1 week ago

Describe the bug when running a test query on successfully deployed phi-3-mini-4k-instruct, i get the following output

Error executing curl command: % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 curl: (7) Failed to connect to localhost port 64063 after 2224 ms: Could not connect to server curl: (3) unmatched brace in URL position 17: generate_kwargs:{temperature:0.5, ^

Mention the platform you are using windows 11 vscode

To Reproduce Steps to reproduce the behavior:

  1. Go to Kaito, install Phi-3-mini-4k
  2. Click on "test"
  3. error appears

Expected behavior get the response from the model

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Add any other context about the problem here.