[BUG] Waiting for the backend service to start.

[jonahzheng]

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

• [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

• [X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

通过docker启动，用openai api

➜  QAnything git:(master) **bash ./run.sh -c cloud -i 0 -b default**
From https://github.com/netease-youdao/QAnything
 * branch            master     -> FETCH_HEAD
当前master分支已是最新，无需更新。
model_size=0B
由于设置了device_id: 0, tensor_parallel自动调整为1
GPUID1=0, GPUID2=0, device_id=0
Do you want to use the previous OPENAI_API_KEY: sk-ct5uZl9DfBw1uU2HLX4C6? (yes/no) 是否使用上次的OPENAI_API_KEY: sk-ct5uZl9DfBw1uU2HLX4C6？(yes/no) 回车默认选yes，请输入:yes
使用上次的配置：
OPENAI_API_KEY: sk-ct5uZl9DfBw1uU2HLX4C6
OPENAI_API_BASE: https://api.moonshot.cn/v1
OPENAI_API_MODEL_NAME: moonshot-v1-8k
OPENAI_API_CONTEXT_LENGTH: 4096
llm_api is set to [cloud]
device_id is set to [0]
runtime_backend is set to [default]
model_name is set to []
conv_template is set to []
tensor_parallel is set to [1]
gpu_memory_utilization is set to [0.81]
Do you want to use the previous ip: localhost? (yes/no) 是否使用上次的ip: ？(yes/no) 回车默认选yes，请输入:
Running under WSL
time="2024-05-21T07:27:36+08:00" level=warning msg="/root/QAnything/docker-compose-windows.yaml: `version` is obsolete"
 Container qanything-container-local  Stopping
 Container qanything-container-local  Stopped
 Container qanything-container-local  Removing
 Container qanything-container-local  Removed
 Container es-container-local  Stopping
 Container milvus-standalone-local  Stopping
 Container mysql-container-local  Stopping
 Container milvus-standalone-local  Stopped
 Container milvus-standalone-local  Removing
 Container mysql-container-local  Stopped
 Container mysql-container-local  Removing
 Container mysql-container-local  Removed
 Container milvus-standalone-local  Removed
 Container milvus-minio-local  Stopping
 Container milvus-etcd-local  Stopping
 Container milvus-minio-local  Stopped
 Container milvus-minio-local  Removing
 Container milvus-etcd-local  Stopped
 Container milvus-etcd-local  Removing
 Container milvus-etcd-local  Removed
 Container milvus-minio-local  Removed
 Container es-container-local  Stopped
 Container es-container-local  Removing
 Container es-container-local  Removed
 Network qanything_milvus_mysql_local  Removing
 Network qanything_milvus_mysql_local  Removed
WARN[0000] /root/QAnything/docker-compose-windows.yaml: `version` is obsolete
[+] Running 7/7
 ✔ Network qanything_milvus_mysql_local  Created                                                                                                                                       0.2s
 ✔ Container mysql-container-local       Started                                                                                                                                       1.2s
 ✔ Container es-container-local          Started                                                                                                                                       1.2s
 ✔ Container milvus-etcd-local           Started                                                                                                                                       1.2s
 ✔ Container milvus-minio-local          Started                                                                                                                                       0.5s
 ✔ Container milvus-standalone-local     Started                                                                                                                                       1.5s
 ✔ Container qanything-container-local   Started                                                                                                                                       2.4s
WARN[0000] /root/QAnything/docker-compose-windows.yaml: `version` is obsolete
qanything-container-local  |
qanything-container-local  | =============================
qanything-container-local  | == Triton Inference Server ==
qanything-container-local  | =============================
qanything-container-local  |
qanything-container-local  | NVIDIA Release 23.05 (build 61161506)
qanything-container-local  | Triton Server Version 2.34.0
qanything-container-local  |
qanything-container-local  | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES.  All rights reserved.
qanything-container-local  |
qanything-container-local  | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES.  All rights reserved.
qanything-container-local  |
qanything-container-local  | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local  | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local  | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local  |
qanything-container-local  | llm_api is set to [cloud]
qanything-container-local  | device_id is set to [0]
qanything-container-local  | runtime_backend is set to [default]
qanything-container-local  | model_name is set to []
qanything-container-local  | conv_template is set to []
qanything-container-local  | tensor_parallel is set to [1]
qanything-container-local  | gpu_memory_utilization is set to [0.81]
qanything-container-local  | GPU ID: 0, 0
qanything-container-local  | GPU1 Model: NVIDIA GeForce GTX 1660 SUPER
qanything-container-local  | Compute Capability: 7.5
qanything-container-local  | OCR_USE_GPU=True because 7.5 >= 7.5
qanything-container-local  | The embed and rerank model will start on 0 GPU
qanything-container-local  | The rerank service is ready! (2/8)
qanything-container-local  | rerank服务已就绪! (2/8)
qanything-container-local  | The paddleocr model will start on 0 GPU
qanything-container-local  | The ocr service is ready! (3/8)
qanything-container-local  | OCR服务已就绪! (3/8)
qanything-container-local  | Waiting for the backend service to start...
qanything-container-local  | 等待启动后端服务
qanything-container-local  | Waiting for the backend service to start...
qanything-container-local  | 等待启动后端服务
qanything-container-local  | Waiting for the backend service to start...
qanything-container-local  | 等待启动后端服务
qanything-container-local  | Waiting for the backend service to start...

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:Ubuntu 22.04 / Windows 10 WSL2
- NVIDIA Driver:  536.23
- CUDA: Build cuda_11.8.r11.8/compiler.31833905_0
- docker: 26.1.3
- docker-compose: 2.24.1
- NVIDIA GPU: NVIDIA GeForce GTX 1660
- NVIDIA GPU Memory: 6144MiB

QAnything日志 | QAnything logs

(base) ➜  debug_logs git:(master) cat sanic_api.log
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
llm_api_serve_port: None
rerank_port: 9001
embed_port: 9001
<Logger debug_logger (INFO)> <Logger qa_logger (INFO)>
INFO:root:OPENAI_API_BASE = https://api.moonshot.cn/v1
INFO:root:OPENAI_API_MODEL_NAME = moonshot-v1-8k
[2024-05-21 07:27:54 +0800] [126] [INFO] Sanic v23.6.0
INFO:sanic.root:Sanic v23.6.0
[2024-05-21 07:27:54 +0800] [126] [INFO] Goin' Fast @ http://0.0.0.0:8777
INFO:sanic.root:Goin' Fast @ http://0.0.0.0:8777
[2024-05-21 07:27:54 +0800] [126] [INFO] mode: production, w/ 10 workers
INFO:sanic.root:mode: production, w/ 10 workers
[2024-05-21 07:27:54 +0800] [126] [INFO] server: sanic, HTTP/1.1
INFO:sanic.root:server: sanic, HTTP/1.1
[2024-05-21 07:27:54 +0800] [126] [INFO] python: 3.10.12
INFO:sanic.root:python: 3.10.12
[2024-05-21 07:27:54 +0800] [126] [INFO] platform: Linux-5.15.146.1-microsoft-standard-WSL2-x86_64-with-glibc2.35
INFO:sanic.root:platform: Linux-5.15.146.1-microsoft-standard-WSL2-x86_64-with-glibc2.35
[2024-05-21 07:27:54 +0800] [126] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
INFO:sanic.root:packages: sanic-routing==23.12.0, sanic-ext==23.6.0ls

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

1

[fi5ee]

同问，该怎么办呢