(qanything) sgitg@sgitg:/workspace/dockerShared/10023/dockerShared/QAnything$ bash ./run.sh -c local -i 6,7 -b hf -m Qwen-7B-QAnything -t qwen-7b-qanything
请输入您使用的大模型B数(示例:1.8B/3B/7B): 7B
model_size=7B
GPUID1=6, GPUID2=7, device_id=6,7
llm_api is set to [local]
device_id is set to [6,7]
runtime_backend is set to [hf]
model_name is set to [Qwen-7B-QAnything]
conv_template is set to [qwen-7b-qanything]
tensor_parallel is set to [1]
gpu_memory_utilization is set to [0.81]
Do you want to use the previous ip: 10.31.2.11? (yes/no) 是否使用上次的ip: ?(yes/no) 回车默认选yes,请输入:
Running under native Linux
time="2024-08-14T16:08:26+08:00" level=warning msg="/workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml: version is obsolete"
Container qanything-container-local Stopping
Container qanything-container-local Stopped
Container qanything-container-local Removing
Container qanything-container-local Removed
Container mysql-container-local Stopping
Container milvus-standalone-local Stopping
Container es-container-local Stopping
Container mysql-container-local Stopped
Container mysql-container-local Removing
Container mysql-container-local Removed
Container es-container-local Stopped
Container es-container-local Removing
Container es-container-local Removed
Container milvus-standalone-local Stopped
Container milvus-standalone-local Removing
Container milvus-standalone-local Removed
Container milvus-etcd-local Stopping
Container milvus-minio-local Stopping
Container milvus-etcd-local Stopped
Container milvus-etcd-local Removing
Container milvus-etcd-local Removed
Container milvus-minio-local Stopped
Container milvus-minio-local Removing
Container milvus-minio-local Removed
Network qanything_milvus_mysql_local Removing
Network qanything_milvus_mysql_local Removed
WARN[0000] /workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml: version is obsolete
Network qanything_milvus_mysql_local Creating
Network qanything_milvus_mysql_local Created
Container milvus-etcd-local Creating
Container mysql-container-local Creating
Container milvus-minio-local Creating
Container es-container-local Creating
Container mysql-container-local Created
Container es-container-local Created
Container milvus-etcd-local Created
Container milvus-minio-local Created
Container milvus-standalone-local Creating
Container milvus-standalone-local Created
Container qanything-container-local Creating
Container qanything-container-local Created
Container milvus-minio-local Starting
Container es-container-local Starting
Container milvus-etcd-local Starting
Container mysql-container-local Starting
Container milvus-minio-local Started
Container milvus-etcd-local Started
Container milvus-standalone-local Starting
Container mysql-container-local Started
Container es-container-local Started
Container milvus-standalone-local Started
Container qanything-container-local Starting
Container qanything-container-local Started
WARN[0000] /workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml: version is obsolete
qanything-container-local |
qanything-container-local | =============================
qanything-container-local | == Triton Inference Server ==
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | local_start:
qanything-container-local | llm_api is set to [local]
qanything-container-local | device_id is set to [6,7]
qanything-container-local | runtime_backend is set to [hf]
qanything-container-local | model_name is set to [Qwen-7B-QAnything]
qanything-container-local | conv_template is set to [qwen-7b-qanything]
qanything-container-local | tensor_parallel is set to [1]
qanything-container-local | gpu_memory_utilization is set to [0.81]
qanything-container-local | checksum e18e2231b7a37236b1ac5b3c30277b48
qanything-container-local | default_checksum e18e2231b7a37236b1ac5b3c30277b48
qanything-container-local | GPU ID: 6, 7
qanything-container-local | GPU1 Model: NVIDIA A800 80GB PCIe
qanything-container-local | Compute Capability: 8.0
qanything-container-local | OCR_USE_GPU=True because 8.0 >= 7.5
qanything-container-local | ====================================================
qanything-container-local | **** 重要提示 ****
qanything-container-local | ====================================================
qanything-container-local |
qanything-container-local | The triton server for embedding and reranker will start on 7 GPUs
qanything-container-local | Executing hf runtime_backend
qanything-container-local | The rerank service is ready! (2/8)
qanything-container-local | rerank服务已就绪! (2/8)
qanything-container-local | The ocr service is ready! (3/8)
qanything-container-local | OCR服务已就绪! (3/8)
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | Waiting for the backend service to start...
qanything-container-local | 等待启动后端服务
qanything-container-local | The qanything backend service is ready! (4/8)
qanything-container-local | qanything后端服务已就绪! (4/8)
qanything-container-local | The embedding and rerank service is ready!. (7.5/8)
qanything-container-local | Embedding 和 Rerank 服务已准备就绪!(7.5/8)
qanything-container-local | 2024-08-14 16:15:50 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:16:35 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:17:20 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:18:05 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:18:50 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:19:36 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:20:21 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:21:06 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:21:51 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | 2024-08-14 16:22:36 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04.
qanything-container-local | % Total % Received % Xferd Average Speed Time Time Time Current
qanything-container-local | Dload Upload Total Spent Left Speed
100 32 100 32 0 0 33826 0 --:--:-- --:--:-- --:--:-- 32000
qanything-container-local | The llm service is ready!, now you can use the qanything service. (8/8)
qanything-container-local | LLM 服务已准备就绪!现在您可以使用qanything服务。(8/8)
qanything-container-local | 开始检查日志文件中的错误信息...
qanything-container-local | /workspace/qanything_local/logs/debug_logs/rerank_server.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/rerank_server.log 以获取更多信息。
qanything-container-local | /workspace/qanything_local/logs/debug_logs/ocr_server.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/ocr_server.log 以获取更多信息。
qanything-container-local | /workspace/qanything_local/logs/debug_logs/sanic_api.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/sanic_api.log 以获取更多信息。
qanything-container-local | Time elapsed: 805 seconds.
qanything-container-local | 已耗时: 805 秒.
qanything-container-local | Please visit the front-end service at [http://10.31.2.11:8777/qanything/] to conduct Q&A.
qanything-container-local | 请在[http://10.31.2.11:8777/qanything/]下访问前端服务来进行问答,如果前端报错,请在浏览器按F12以获取更多报错信息
是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?
当前行为 | Current Behavior
1个月前流畅使用,一个月内没有使用后,再次使用 bash ./run.sh -c local -i 6,7 -b hf -m Qwen-7B-QAnything -t qwen-7b-qanything启动服务时,遇见启动后端时间太长的问题,修改超时限制后,每次起服务总用时总为805秒。
(qanything) sgitg@sgitg:/workspace/dockerShared/10023/dockerShared/QAnything$ bash ./run.sh -c local -i 6,7 -b hf -m Qwen-7B-QAnything -t qwen-7b-qanything 请输入您使用的大模型B数(示例:1.8B/3B/7B): 7B model_size=7B GPUID1=6, GPUID2=7, device_id=6,7 llm_api is set to [local] device_id is set to [6,7] runtime_backend is set to [hf] model_name is set to [Qwen-7B-QAnything] conv_template is set to [qwen-7b-qanything] tensor_parallel is set to [1] gpu_memory_utilization is set to [0.81] Do you want to use the previous ip: 10.31.2.11? (yes/no) 是否使用上次的ip: ?(yes/no) 回车默认选yes,请输入: Running under native Linux time="2024-08-14T16:08:26+08:00" level=warning msg="/workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml:
version
is obsolete" Container qanything-container-local Stopping Container qanything-container-local Stopped Container qanything-container-local Removing Container qanything-container-local Removed Container mysql-container-local Stopping Container milvus-standalone-local Stopping Container es-container-local Stopping Container mysql-container-local Stopped Container mysql-container-local Removing Container mysql-container-local Removed Container es-container-local Stopped Container es-container-local Removing Container es-container-local Removed Container milvus-standalone-local Stopped Container milvus-standalone-local Removing Container milvus-standalone-local Removed Container milvus-etcd-local Stopping Container milvus-minio-local Stopping Container milvus-etcd-local Stopped Container milvus-etcd-local Removing Container milvus-etcd-local Removed Container milvus-minio-local Stopped Container milvus-minio-local Removing Container milvus-minio-local Removed Network qanything_milvus_mysql_local Removing Network qanything_milvus_mysql_local Removed WARN[0000] /workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml:version
is obsolete Network qanything_milvus_mysql_local Creating Network qanything_milvus_mysql_local Created Container milvus-etcd-local Creating Container mysql-container-local Creating Container milvus-minio-local Creating Container es-container-local Creating Container mysql-container-local Created Container es-container-local Created Container milvus-etcd-local Created Container milvus-minio-local Created Container milvus-standalone-local Creating Container milvus-standalone-local Created Container qanything-container-local Creating Container qanything-container-local Created Container milvus-minio-local Starting Container es-container-local Starting Container milvus-etcd-local Starting Container mysql-container-local Starting Container milvus-minio-local Started Container milvus-etcd-local Started Container milvus-standalone-local Starting Container mysql-container-local Started Container es-container-local Started Container milvus-standalone-local Started Container qanything-container-local Starting Container qanything-container-local Started WARN[0000] /workspace/dockerShared/10023/dockerShared/QAnything/docker-compose-linux.yaml:version
is obsolete qanything-container-local | qanything-container-local | ============================= qanything-container-local | == Triton Inference Server == qanything-container-local | ============================= qanything-container-local | qanything-container-local | NVIDIA Release 23.05 (build 61161506) qanything-container-local | Triton Server Version 2.34.0 qanything-container-local | qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License. qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license: qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license qanything-container-local | qanything-container-local | local_start: qanything-container-local | llm_api is set to [local] qanything-container-local | device_id is set to [6,7] qanything-container-local | runtime_backend is set to [hf] qanything-container-local | model_name is set to [Qwen-7B-QAnything] qanything-container-local | conv_template is set to [qwen-7b-qanything] qanything-container-local | tensor_parallel is set to [1] qanything-container-local | gpu_memory_utilization is set to [0.81] qanything-container-local | checksum e18e2231b7a37236b1ac5b3c30277b48 qanything-container-local | default_checksum e18e2231b7a37236b1ac5b3c30277b48 qanything-container-local | GPU ID: 6, 7 qanything-container-local | GPU1 Model: NVIDIA A800 80GB PCIe qanything-container-local | Compute Capability: 8.0 qanything-container-local | OCR_USE_GPU=True because 8.0 >= 7.5 qanything-container-local | ==================================================== qanything-container-local | **** 重要提示 **** qanything-container-local | ==================================================== qanything-container-local | qanything-container-local | The triton server for embedding and reranker will start on 7 GPUs qanything-container-local | Executing hf runtime_backend qanything-container-local | The rerank service is ready! (2/8) qanything-container-local | rerank服务已就绪! (2/8) qanything-container-local | The ocr service is ready! (3/8) qanything-container-local | OCR服务已就绪! (3/8) qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | Waiting for the backend service to start... qanything-container-local | 等待启动后端服务 qanything-container-local | The qanything backend service is ready! (4/8) qanything-container-local | qanything后端服务已就绪! (4/8) qanything-container-local | The embedding and rerank service is ready!. (7.5/8) qanything-container-local | Embedding 和 Rerank 服务已准备就绪!(7.5/8) qanything-container-local | 2024-08-14 16:15:50 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:16:35 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:17:20 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:18:05 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:18:50 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:19:36 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:20:21 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:21:06 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:21:51 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | 2024-08-14 16:22:36 | INFO | model_worker | Send heart beat. Models: ['Qwen-7B-QAnything']. Semaphore: None. call_ct: 0. worker_id: 8902dc04. qanything-container-local | % Total % Received % Xferd Average Speed Time Time Time Current qanything-container-local | Dload Upload Total Spent Left Speed 100 32 100 32 0 0 33826 0 --:--:-- --:--:-- --:--:-- 32000 qanything-container-local | The llm service is ready!, now you can use the qanything service. (8/8) qanything-container-local | LLM 服务已准备就绪!现在您可以使用qanything服务。(8/8) qanything-container-local | 开始检查日志文件中的错误信息... qanything-container-local | /workspace/qanything_local/logs/debug_logs/rerank_server.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/rerank_server.log 以获取更多信息。 qanything-container-local | /workspace/qanything_local/logs/debug_logs/ocr_server.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/ocr_server.log 以获取更多信息。 qanything-container-local | /workspace/qanything_local/logs/debug_logs/sanic_api.log 中未检测到明确的错误信息。请手动排查 /workspace/qanything_local/logs/debug_logs/sanic_api.log 以获取更多信息。 qanything-container-local | Time elapsed: 805 seconds. qanything-container-local | 已耗时: 805 秒. qanything-container-local | Please visit the front-end service at [http://10.31.2.11:8777/qanything/] to conduct Q&A. qanything-container-local | 请在[http://10.31.2.11:8777/qanything/]下访问前端服务来进行问答,如果前端报错,请在浏览器按F12以获取更多报错信息期望行为 | Expected Behavior
正常启动
运行环境 | Environment
QAnything日志 | QAnything logs
日志正常,就是时间很长: UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:16:44 +0800] [5418] [INFO] ┌─────────────────────────────────────────────────────────────────────────────────┐ │ Sanic v23.6.0 │ │ Goin' Fast @ http://0.0.0.0:8777 │ ├───────────────────────┬─────────────────────────────────────────────────────────┤ │ │ mode: production, w/ 10 workers │ │ ▄███ █████ ██ │ server: sanic, HTTP/1.1 │ │ ██ │ python: 3.10.12 │ │ ▀███████ ███▄ │ platform: Linux-5.15.0-78-generic-x86_64-with-glibc2.35 │ │ ██ │ packages: sanic-routing==23.12.0, sanic-ext==23.6.0 │ │ ████ ████████▀ │ │ │ │ │ │ Build Fast. Run Fast. │ │ └───────────────────────┴─────────────────────────────────────────────────────────┘
INFO:sanic.root: ┌─────────────────────────────────────────────────────────────────────────────────┐ │ Sanic v23.6.0 │ │ Goin' Fast @ http://0.0.0.0:8777 │ ├───────────────────────┬─────────────────────────────────────────────────────────┤ │ │ mode: production, w/ 10 workers │ │ ▄███ █████ ██ │ server: sanic, HTTP/1.1 │ │ ██ │ python: 3.10.12 │ │ ▀███████ ███▄ │ platform: Linux-5.15.0-78-generic-x86_64-with-glibc2.35 │ │ ██ │ packages: sanic-routing==23.12.0, sanic-ext==23.6.0 │ │ ████ ████████▀ │ │ │ │ │ │ Build Fast. Run Fast. │ │ └───────────────────────┴─────────────────────────────────────────────────────────┘
[2024-08-14 16:16:44 +0800] [5418] [WARNING] Sanic is running in PRODUCTION mode. Consider using '--debug' or '--dev' while actively developing your application. WARNING:sanic.error:Sanic is running in PRODUCTION mode. Consider using '--debug' or '--dev' while actively developing your application. UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 ^[[B<Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content llm_api_serve_port: 7802 rerank_port: 9001 embed_port: 9001 <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:25:43 +0800] [5962] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:43 +0800] [5962] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:43 +0800] [5962] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:43 +0800] [5962] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:43 +0800] [5962] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] [2024-08-14 16:25:43 +0800] [5958] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:43 +0800] [5958] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:43 +0800] [5958] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:43 +0800] [5958] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:43 +0800] [5958] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:25:43 +0800] [5958] [INFO] Starting worker [5958] INFO:sanic.server:Starting worker [5958] [2024-08-14 16:25:43 +0800] [5962] [INFO] Starting worker [5962] INFO:sanic.server:Starting worker [5962] <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:25:49 +0800] [5956] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:49 +0800] [5956] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:49 +0800] [5956] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:49 +0800] [5956] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:49 +0800] [5956] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] [2024-08-14 16:25:49 +0800] [5959] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:49 +0800] [5959] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:49 +0800] [5959] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:49 +0800] [5959] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:49 +0800] [5959] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 [2024-08-14 16:25:49 +0800] [5960] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:49 +0800] [5960] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:49 +0800] [5960] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:49 +0800] [5960] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:49 +0800] [5960] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:25:49 +0800] [5956] [INFO] Starting worker [5956] INFO:sanic.server:Starting worker [5956] [2024-08-14 16:25:49 +0800] [5959] [INFO] Starting worker [5959] INFO:sanic.server:Starting worker [5959] [2024-08-14 16:25:49 +0800] [5960] [INFO] Starting worker [5960] INFO:sanic.server:Starting worker [5960] <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:25:53 +0800] [5964] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:53 +0800] [5964] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:53 +0800] [5964] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:53 +0800] [5964] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:53 +0800] [5964] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:25:53 +0800] [5964] [INFO] Starting worker [5964] INFO:sanic.server:Starting worker [5964] <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:25:57 +0800] [5965] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:25:57 +0800] [5965] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:25:57 +0800] [5965] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:25:57 +0800] [5965] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:25:57 +0800] [5965] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:25:57 +0800] [5965] [INFO] Starting worker [5965] INFO:sanic.server:Starting worker [5965] <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> <Logger debug_logger (INFO)> <Logger qa_logger (INFO)> [2024-08-14 16:26:01 +0800] [5957] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:26:01 +0800] [5957] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:26:01 +0800] [5957] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:26:01 +0800] [5957] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:26:01 +0800] [5957] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:26:02 +0800] [5957] [INFO] Starting worker [5957] INFO:sanic.server:Starting worker [5957] INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None INFO:root:OPENAI_API_BASE = None INFO:root:OPENAI_API_MODEL_NAME = None [2024-08-14 16:26:03 +0800] [5961] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:26:03 +0800] [5961] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:26:03 +0800] [5961] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:26:03 +0800] [5961] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:26:03 +0800] [5961] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] [2024-08-14 16:26:03 +0800] [5963] [INFO] Sanic Extensions: INFO:sanic.root:Sanic Extensions: [2024-08-14 16:26:03 +0800] [5963] [INFO] > injection [0 dependencies; 0 constants] INFO:sanic.root: > injection [0 dependencies; 0 constants] [2024-08-14 16:26:03 +0800] [5963] [INFO] > openapi [http://0.0.0.0:8777/docs] INFO:sanic.root: > openapi [http://0.0.0.0:8777/docs] [2024-08-14 16:26:03 +0800] [5963] [INFO] > http INFO:sanic.root: > http [2024-08-14 16:26:03 +0800] [5963] [INFO] > templating [jinja2==3.1.3] INFO:sanic.root: > templating [jinja2==3.1.3] INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:ZiyueLLM offcut_token: 0 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:[SUCCESS] 数据库qanything检查通过 INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local INFO:debug_logger:ADD COLUMN timestamp INFO:debug_logger:1060 (42S21): Duplicate column name 'timestamp' INFO:debug_logger:[SUCCESS] 数据库qanything连接成功 init local_doc_qa in local [2024-08-14 16:26:04 +0800] [5963] [INFO] Starting worker [5963] INFO:sanic.server:Starting worker [5963] [2024-08-14 16:26:04 +0800] [5961] [INFO] Starting worker [5961] INFO:sanic.server:Starting worker [5961]
复现方法 | Steps To Reproduce
No response
备注 | Anything else?
No response