netease-youdao / QAnything

Question and Answer based on Anything.
https://qanything.ai
Apache License 2.0
10.58k stars 1.02k forks source link

[BUG] 使用bash run_for_openai_api_with_cpu_in_Linux_or_WSL.sh --single-process启动纯python环境无法进入前端页面 #228

Open loong1118 opened 3 months ago

loong1118 commented 3 months ago

是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?

该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?

当前行为 | Current Behavior

No response

期望行为 | Expected Behavior

No response

运行环境 | Environment

CPU环境

QAnything日志 | QAnything logs

2024-04-09 09:19:52,523 - [PID: 2538979][MainProcess] - [Function: ] - INFO - 开始从https://aiinfra.pkgs.visualstudio.com/PublicPackages/_apis/packaging/feeds/9387c3aa-d9ad-4513-968c-383f6f7f53b8/pypi/packages/onnxruntime-gpu/versions/1.17.1/onnxruntime_gpu-1.17.1-cp311-cp311-manylinux_2_28_x86_64.whl/content下载onnxruntime,也可以手动下载并通过pip install *.whl安装 2024-04-09 09:45:10,867 - [PID: 2546516][MainProcess] - [Function: ] - INFO - 开始下载rerank模型:netease-youdao/bce-reranker-base_v1 2024-04-09 09:45:18,555 - [PID: 2546516][MainProcess] - [Function: ] - INFO - 模型下载完毕!cache地址:/root/.cache/modelscope/hub/netease-youdao/bce-reranker-base_v1, 软链接地址:/mnt/qa/QAnything/qanything_kernel/connector/rerank/rerank_model_configs_v0.0.1 2024-04-09 09:45:18,557 - [PID: 2546516][MainProcess] - [Function: ] - INFO - 开始下载embedding模型:netease-youdao/bce-embedding-base_v1 2024-04-09 09:45:27,519 - [PID: 2546516][MainProcess] - [Function: ] - INFO - 模型下载完毕!cache地址:/root/.cache/modelscope/hub/netease-youdao/bce-embedding-base_v1, 软链接地址:/mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1 2024-04-09 09:45:27,956 - [PID: 2546516][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:08,549 - [PID: 2550618][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:13,493 - [PID: 2550683][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:18,613 - [PID: 2550724][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:18,717 - [PID: 2550723][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:18,718 - [PID: 2550726][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:18,738 - [PID: 2550725][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 09:59:18,781 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 09:59:18,781 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 09:59:18,781 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 09:59:18,781 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 09:59:18,866 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 09:59:18,866 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 09:59:18,866 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 09:59:18,866 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 09:59:18,878 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 09:59:18,878 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 09:59:18,878 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 09:59:18,878 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 09:59:18,885 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 09:59:18,885 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 09:59:18,885 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 09:59:18,885 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 09:59:25,863 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 09:59:25,871 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 09:59:25,928 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 09:59:25,945 - [PID: 2550726][Sanic-Server-3-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 09:59:25,947 - [PID: 2550725][Sanic-Server-2-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 09:59:25,951 - [PID: 2550723][Sanic-Server-0-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 09:59:26,095 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 09:59:26,096 - [PID: 2550724][Sanic-Server-1-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:00:41,633 - [PID: 2551702][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:46,741 - [PID: 2551763][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:51,829 - [PID: 2551798][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:51,907 - [PID: 2551799][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:51,918 - [PID: 2551797][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:51,952 - [PID: 2551796][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:00:52,002 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:00:52,003 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:00:52,003 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:00:52,003 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:00:52,065 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:00:52,065 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:00:52,065 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:00:52,065 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:00:52,113 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:00:52,114 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:00:52,114 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:00:52,114 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:00:52,140 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:00:52,140 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:00:52,141 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:00:52,141 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:00:58,894 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:00:58,895 - [PID: 2551798][Sanic-Server-2-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:00:58,968 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:00:58,969 - [PID: 2551799][Sanic-Server-3-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:00:59,050 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:00:59,051 - [PID: 2551796][Sanic-Server-0-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:00:59,285 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:00:59,286 - [PID: 2551797][Sanic-Server-1-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:02:59,087 - [PID: 2552589][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:04,092 - [PID: 2552618][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:09,172 - [PID: 2552685][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:09,237 - [PID: 2552686][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:09,357 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:03:09,357 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:03:09,357 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:03:09,357 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:03:09,412 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:03:09,412 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:03:09,412 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:03:09,412 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:03:09,467 - [PID: 2552687][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:09,503 - [PID: 2552684][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:03:09,646 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:03:09,646 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:03:09,646 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:03:09,646 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:03:09,670 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:03:09,670 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:03:09,670 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:03:09,670 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:03:16,129 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:03:16,130 - [PID: 2552686][Sanic-Server-2-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:03:16,133 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:03:16,134 - [PID: 2552685][Sanic-Server-1-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:03:16,590 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:03:16,591 - [PID: 2552684][Sanic-Server-0-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:03:16,596 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:03:16,597 - [PID: 2552687][Sanic-Server-3-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:03:20,439 - [PID: 2552685][Sanic-Server-1-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:03:20,440 - [PID: 2552685][Sanic-Server-1-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.108420133590698 seconds. 2024-04-09 10:03:20,542 - [PID: 2552686][Sanic-Server-2-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:03:20,542 - [PID: 2552686][Sanic-Server-2-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.156201124191284 seconds. 2024-04-09 10:03:20,975 - [PID: 2552684][Sanic-Server-0-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:03:20,976 - [PID: 2552684][Sanic-Server-0-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.332270622253418 seconds. 2024-04-09 10:03:21,113 - [PID: 2552687][Sanic-Server-3-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:03:21,114 - [PID: 2552687][Sanic-Server-3-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.498265266418457 seconds. 2024-04-09 10:18:32,708 - [PID: 2559806][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:37,656 - [PID: 2559835][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:42,839 - [PID: 2559871][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:42,889 - [PID: 2559869][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:42,960 - [PID: 2559872][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:43,001 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:18:43,002 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:18:43,002 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:18:43,002 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:18:43,056 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:18:43,056 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:18:43,057 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:18:43,057 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:18:43,060 - [PID: 2559870][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 10:18:43,125 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:18:43,125 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:18:43,125 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:18:43,125 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:18:43,233 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 10:18:43,234 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 10:18:43,234 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 10:18:43,234 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 10:18:49,854 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:18:49,855 - [PID: 2559871][Sanic-Server-2-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:18:49,868 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:18:49,869 - [PID: 2559869][Sanic-Server-0-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:18:50,040 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:18:50,041 - [PID: 2559872][Sanic-Server-3-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:18:50,216 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 10:18:50,217 - [PID: 2559870][Sanic-Server-1-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 10:18:54,529 - [PID: 2559871][Sanic-Server-2-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:18:54,529 - [PID: 2559871][Sanic-Server-2-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.553175926208496 seconds. 2024-04-09 10:18:54,554 - [PID: 2559869][Sanic-Server-0-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:18:54,555 - [PID: 2559869][Sanic-Server-0-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.523957252502441 seconds. 2024-04-09 10:18:54,776 - [PID: 2559872][Sanic-Server-3-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:18:54,777 - [PID: 2559872][Sanic-Server-3-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.677401542663574 seconds. 2024-04-09 10:18:54,955 - [PID: 2559870][Sanic-Server-1-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 10:18:54,955 - [PID: 2559870][Sanic-Server-1-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.747874975204468 seconds. 2024-04-09 13:42:10,150 - [PID: 2622524][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:14,959 - [PID: 2622588][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:20,119 - [PID: 2622632][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:20,120 - [PID: 2622630][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:20,168 - [PID: 2622631][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:20,249 - [PID: 2622633][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:42:20,283 - [PID: 2622632][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:42:20,283 - [PID: 2622632][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:42:20,284 - [PID: 2622632][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:42:20,284 - [PID: 2622632][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:42:20,285 - [PID: 2622630][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:42:20,285 - [PID: 2622630][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:42:20,285 - [PID: 2622630][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:42:20,285 - [PID: 2622630][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:42:20,330 - [PID: 2622631][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:42:20,331 - [PID: 2622631][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:42:20,331 - [PID: 2622631][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:42:20,331 - [PID: 2622631][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:42:20,418 - [PID: 2622633][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:42:20,418 - [PID: 2622633][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:42:20,419 - [PID: 2622633][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:42:20,419 - [PID: 2622633][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:42:55,173 - [PID: 2622929][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:00,059 - [PID: 2622959][MainProcess] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:05,084 - [PID: 2623027][Sanic-Server-2-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:05,117 - [PID: 2623026][Sanic-Server-1-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:05,226 - [PID: 2623028][Sanic-Server-3-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:05,251 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:43:05,251 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:43:05,252 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:43:05,252 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:43:05,286 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:43:05,287 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:43:05,287 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:43:05,287 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:43:05,304 - [PID: 2623025][Sanic-Server-0-0] - [Function: ] - INFO - 使用openai api Qwen1.5-14B-Chat 无需下载大模型 2024-04-09 13:43:05,401 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:43:05,401 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:43:05,401 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:43:05,401 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:43:05,468 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_KEY = your-api-key-here 2024-04-09 13:43:05,469 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_BASE = http://117.16.8.29:30533/v1 2024-04-09 13:43:05,469 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_MODEL_NAME = Qwen1.5-14B-Chat 2024-04-09 13:43:05,469 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - OPENAI_API_CONTEXT_LENGTH = 4096 2024-04-09 13:43:11,957 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 13:43:11,958 - [PID: 2623027][Sanic-Server-2-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 13:43:12,408 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 13:43:12,410 - [PID: 2623026][Sanic-Server-1-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 13:43:12,443 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 13:43:12,444 - [PID: 2623028][Sanic-Server-3-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 13:43:12,541 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - EmbeddingClient: model_path: /mnt/qa/QAnything/qanything_kernel/connector/embedding/embedding_model_configs_v0.0.1/embed.onnx 2024-04-09 13:43:12,542 - [PID: 2623025][Sanic-Server-0-0] - [Function: init] - INFO - [SUCCESS] 数据库/mnt/qa/QAnything/QANY_DB/qanything.db连接成功 2024-04-09 13:43:16,195 - [PID: 2623027][Sanic-Server-2-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 13:43:16,196 - [PID: 2623027][Sanic-Server-2-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 10.97055959701538 seconds. 2024-04-09 13:43:16,981 - [PID: 2623026][Sanic-Server-1-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 13:43:16,981 - [PID: 2623026][Sanic-Server-1-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.719924926757812 seconds. 2024-04-09 13:43:16,984 - [PID: 2623028][Sanic-Server-3-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 13:43:16,984 - [PID: 2623028][Sanic-Server-3-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.609542846679688 seconds. 2024-04-09 13:43:17,080 - [PID: 2623025][Sanic-Server-0-0] - [Function: init_cfg] - INFO - OCR DEVICE: cpu 2024-04-09 13:43:17,080 - [PID: 2623025][Sanic-Server-0-0] - [Function: init_local_doc_qa] - INFO - LocalDocQA started in 11.637018918991089 seconds.

复现方法 | Steps To Reproduce

1.安装环境 2.opeai_api key 是空,url自己部署在本地 3.使用命令启动 bash run_for_openai_api_with_cpu_in_Linux_or_WSL.sh --single-process

备注 | Anything else?

No response

loong1118 commented 3 months ago

2 1

wxhheian commented 1 month ago

同样遇到了这个问题,请问现在有解决吗