Open xixia03 opened 7 months ago
看到有个issue中是因为Windows下换行符导致的报错,但这个是在ubantu环境跑的,报错提示信息中也没有换行符相关的报错
看到有个issue中是因为Windows下换行符导致的报错,但这个是在ubantu环境跑的,报错提示信息中也没有换行符相关的报错
是在容器里这个路径:/workspace/qanything_local/scripts/下 ,或者你重新部一下
`qanything_local: container_name: qanything-container-local image: freeren/qanything:v1.2.2
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: "all"
capabilities: ["gpu"]
command: /bin/bash -c 'if [ "${LLM_API}" = "local" ]; then /workspace/qanything_local/scripts/run_for_local_option.sh -c $LLM_API -i $DEVICE_ID -b $RUNTIME_BACKEND -m $MODEL_NAME -t $CONV_TEMPLATE -p >
privileged: true
shm_size: '8gb'
volumes:
- ${DOCKER_VOLUME_DIRECTORY:-.}/assets/custom_models:/model_repos/CustomLLM
- ${DOCKER_VOLUME_DIRECTORY:-.}/:/workspace/qanything_local/
ports:
- "8777:8777"
environment:
- NCCL_LAUNCH_MODE=PARALLEL
- GPUID1=${GPUID1:-0}
- GPUID2=${GPUID2:-0}
- MODEL_SIZE=${MODEL_SIZE:-0B}
- USER_IP=${USER_IP:-localhost}
depends_on:
- "standalone"
- "mysql"
- "elasticsearch"
tty: true
stdin_open: true
` i dont found any wrong space in the docker compose file though.
启动过程中打印的信息如下: (base) root@cg:/home/jovyan/work/QAnything/QAnything# bash run.sh From https://github.com/netease-youdao/QAnything
version
is obsolete" Container qanything-container-local Stopping Container qanything-container-local Stopped Container qanything-container-local Removing Container qanything-container-local Removed Container mysql-container-local Stopping Container milvus-standalone-local Stopping Container milvus-standalone-local Stopped Container milvus-standalone-local Removing Container milvus-standalone-local Removed Container milvus-minio-local Stopping Container milvus-etcd-local Stopping Container milvus-etcd-local Stopped Container milvus-etcd-local Removing Container milvus-etcd-local Removed Container mysql-container-local Stopped Container mysql-container-local Removing Container mysql-container-local Removed Container milvus-minio-local Stopped Container milvus-minio-local Removing Container milvus-minio-local Removed Network qanything_milvus_mysql_local Removing Network qanything_milvus_mysql_local Removed WARN[0000] /home/jovyan/work/wangyi/QAnything/docker-compose-linux.yaml:version
is obsolete [+] Running 5/6 ? Network qanything_milvus_mysql_local Created 1.0s ? Container milvus-etcd-local Started 0.3s ? Container milvus-minio-local Started 0.3s ? Container mysql-container-local Started 0.3s ? Container milvus-standalone-local Started 0.5s ? Container qanything-container-local Started 1.0s WARN[0000] /home/jovyan/work/wangyi/QAnything/docker-compose-linux.yaml:version
is obsolete qanything-container-local | qanything-container-local | ============================= qanything-container-local | == Triton Inference Server == qanything-container-local | ============================= qanything-container-local | qanything-container-local | NVIDIA Release 23.05 (build 61161506) qanything-container-local | Triton Server Version 2.34.0 qanything-container-local | qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License. qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license: qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license qanything-container-local | qanything-container-local | NOTE: CUDA Forward Compatibility mode ENABLED. qanything-container-local | Using CUDA 12.1 driver version 530.30.02 with kernel driver version 525.125.06. qanything-container-local | See https://docs.nvidia.com/deploy/cuda-compatibility/ for details. qanything-container-local | qanything-container-local | /bin/bash: line 1: /workspace/qanything_local/scripts/run_for_local_option.sh: No such file or directory查看容器确实没有这个文件:
各位大佬们,请问下可能是哪里出的问题