Closed gujingit closed 5 months ago
/kind bug
arena version:
arena version arena: v0.9.12 BuildDate: 2024-03-04T01:59:47Z GitCommit: a707f81ef611ccd4347c82ddef122cf40b660edc GitTreeState: clean GitTag: v0.9.12 GoVersion: go1.18.10 Compiler: gc Platform: darwin/amd64
submit kserve job
arena serve kserve \ --name=triton-vllm \ --image=nvcr.io/nvidia/tritonserver:24.01-vllm-python-py3 \ --gpus=1 \ --cpu=6 \ --memory=12Gi \ --data="opt-pvc:/work/model_repository/vllm-model" \ "tritonserver --model-store=/work/model_repository --grpc-port=9000 --http-port=8080 --allow-grpc=true --allow-http=true --allow-metrics=true"
arena delete triton-vllm --type kserve
ERRO[0000] Unsupport job type,arena only supports: [py(Pytorch),horovod(Horovod),volcano(Volcano),et(ElasticTraining),spark(Spark),dp(DeepSpeed),tf(Tensorflow),mpi(MPI)]
/assign gujingit
@gujingit arena delete is used to delete training jobs; you should use arena serve delete.
/kind bug
arena version:
submit kserve job
arena delete triton-vllm --type kserve