-
### What
The living doc is the main place for the end-user for information on what to do after the superwerker installation. We want to make it easier to understand the individual features of super…
-
### Prerequisites
* [ ] Aqara E1 TRV
Zigbee2MQTT
```
{
"away_preset_temperature": "5.0",
"battery": 0,
"calibrated": true,
"child_lock": false,
"device_temperature": 2…
-
### Your current environment
### Model Input Dumps
_No response_
### 🐛 Describe the bug
doc…
-
### 📚 The doc issue
Currently, documentation is written in ReStructuredText which is feature-rich but not as simple and popular as Markdown. This could be a barrier for people who are new to rST bu…
-
### Your current environment
我需要softmax之前的logits，但是目前vllm好像返回不了logits，huggingface transformer是可以的。请问vllm怎么实现呢？
### How would you like to use vllm
_No response_
### Before submitting a new issue...…
-
### 🚀 The feature, motivation and pitch
After https://github.com/vllm-project/vllm/pull/9228 , we should be able to install a developing version of vllm locally using macos.
Mainly need to clean u…
-
### 🚀 The feature, motivation and pitch
I'm currently making an agent using LLM which required using external tools. There is step in completion where tools is required to be called but what kind of …
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
### Model Input Dumps
Google Colab with T4 GPU
### 🐛 Descr…
-
### 🚀 The feature, motivation and pitch
I'm glad to use the vLLM framework to accelerate LLM inference. Could you provide support for the LoRA fine-tuned model of DeepSeek V2?
### Alternatives
_No …
-
### Your current environment
```text
The output of `python collect_env.py`
```
### How you are installing vllm
```sh
pip install -vvv vllm
```
### Before submitting a new issue...
- [X] M…