use env var for model path - Githubissues

KempnerInstitute / distributed-inference-vllm

Distributed Inference with vLLM

Apache License 2.0

0 stars 0 forks source link

use env var for model path #8

Open mmshad opened 1 month ago

mmshad commented 1 month ago

Use an env variable for model path and reference at the end.

https://github.com/KempnerInstitute/distributed-inference-vllm/blob/6c8612f1761bd6496882d7fe624381aa07d44841/server/405b_slurm.sh#L56