search

TabbyML / tabby

Self-hosted AI coding assistant
https://tabbyml.com
Other
21.89k stars 997 forks source link

With stream: false: The application panicked (crashed): Failed to commit changes: IoError(Os { code: 5, kind: PermissionDenied, message: "Access is denied." }) #3179

Open Boscop opened 1 month ago

Boscop commented 1 month ago 
> C:\tabby_x86_64-windows-msvc-cuda122\tabby.exe serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda --port 7488

████████╗ █████╗ ██████╗ ██████╗ ██╗   ██╗
╚══██╔══╝██╔══██╗██╔══██╗██╔══██╗╚██╗ ██╔╝
   ██║   ███████║██████╔╝██████╔╝ ╚████╔╝
   ██║   ██╔══██║██╔══██╗██╔══██╗  ╚██╔╝
   ██║   ██║  ██║██████╔╝██████╔╝   ██║
   ╚═╝   ╚═╝  ╚═╝╚═════╝ ╚═════╝    ╚═╝

📄 Version 0.17.0
🚀 Listening at http://0.0.0.0:7488

2024-09-20T17:25:42.434984Z  WARN chat_completions{user=Some("E16n1q")}: tabby::routes::chat: crates\tabby\src\routes\chat.rs:48: Error happens during chat completion: invalid args: When stream is false, use Chat::create
2024-09-20T17:25:55.511697Z  WARN chat_completions{user=Some("E16n1q")}: tabby::routes::chat: crates\tabby\src\routes\chat.rs:48: Error happens during chat completion: invalid args: When stream is false, use Chat::create
2024-09-20T17:26:11.060370Z  WARN chat_completions{user=Some("E16n1q")}: tabby::routes::chat: crates\tabby\src\routes\chat.rs:48: Error happens during chat completion: invalid args: When stream is false, use Chat::create
2024-09-20T17:26:27.724678Z  WARN chat_completions{user=Some("E16n1q")}: tabby::routes::chat: crates\tabby\src\routes\chat.rs:48: Error happens during chat completion: invalid args: When stream is false, use Chat::create
The application panicked (crashed).
Message:  Failed to commit changes: IoError(Os { code: 5, kind: PermissionDenied, message: "Access is denied." })
Location: crates\tabby-index\src\indexer.rs:295

  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
   1: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
   2: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
   3: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
   4: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
   5: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
   6: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
   7: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
   8: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
   9: git_credential_userpass_plaintext_new<unknown>
      at <unknown source file>:<unknown line>
  10: git_credential_userpass_plaintext_new<unknown>
      at <unknown source file>:<unknown line>
  11: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
  12: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
  13: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
  14: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
  15: git_filter_source_repo<unknown>
      at <unknown source file>:<unknown line>
  16: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  17: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  18: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  19: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  20: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  21: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  22: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  23: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  24: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  25: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  26: git_filter_source_mode<unknown>
      at <unknown source file>:<unknown line>
  27: BaseThreadInitThunk<unknown>
      at <unknown source file>:<unknown line>
  28: RtlUserThreadStart<unknown>
      at <unknown source file>:<unknown line>

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.

Describe the bug

Error happens during chat completion: invalid args: When stream is false, use Chat::create The application panicked (crashed). Message: Failed to commit changes: IoError(Os { code: 5, kind: PermissionDenied, message: "Access is denied." }) Location: crates\tabby-index\src\indexer.rs:295

Information about your version tabby 0.17.0

Information about your GPU

C:\Users\me>nvidia-smi
Fri Sep 20 21:28:09 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 537.13                 Driver Version: 537.13       CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                     TCC/WDDM  | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 4060 ...  WDDM  | 00000000:01:00.0 Off |                  N/A |
| N/A   43C    P8               2W / 115W |   5467MiB /  8188MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|    0   N/A  N/A      8356    C+G   ...pps\paint.net\5.0.9\paintdotnet.exe    N/A      |
|    0   N/A  N/A      9736      C   ...ndows-msvc-cuda122\llama-server.exe    N/A      |
|    0   N/A  N/A     25912      C   ...ndows-msvc-cuda122\llama-server.exe    N/A      |
|    0   N/A  N/A     46396      C   ...ndows-msvc-cuda122\llama-server.exe    N/A      |
+---------------------------------------------------------------------------------------+

Additional context I was posting some completion requests to the API via curl, I was trying to get a non-streaming response by setting stream to false, which didn't work.

wsxiaoys commented 1 month ago

This is WAI (though the error message could surely be improved), see https://github.com/TabbyML/tabby/issues/2807