-
I'm curious about how careful I need to be with batching. If I batch together 50 calls of which which there are 5 unique prefixes (a,b,c,d,e), will it know to group those together. Or should I be care…
srush updated
9 months ago
-
### Describe the issue
**Issue**:
So i updated the repo and now i can not start the server anymore. I deleted the repo and cloned it again, but get the same error.
**System**:
Win10 WSL2 Ubunt…
-
1.5版本的模型支持functon call吗，我用之前qwen的例子试了一下，好像不行。我用的是llama_cpp部署的gguf，是姿势不对吗
-
# ⭐ Suggestion
Currently there is not possible values for `--lang` argument. This makes people confusing which language is supported.
https://docs.rs/clap/latest/clap/trait.ValueEnum.html#tymeth…
-
### Your current environment
```text
git clone https://github.com/vllm-project/vllm.git
cd ~/vllm
conda create -n vllm -y
conda activate vllm
conda install python=3.10 -y
pip install -e .
pip …
-
I have no idea how to contribute translations otherwise:
plugins/simplegallery/js/lang/de.js:`
_sgLang = [];
_sgLang['cancel'] = 'Abbrechen';
_sgLang['from'] = 'von';
_sgLang['close'] = 'Schl…