-
### 🚀 The feature, motivation and pitch
PPO and a number of other LLM fine-tuning techniques require autoregressive generation as part of the training process. When using vLLM to speed up the autor…
-
Hello everybody,
I'm installing on a raspberry pi 3 a LoRa network by following the tutorial https://www.loraserver.io/loraserver/overview/ . I'm currently stack at the step of the certificate an…
-
this screen apears when i import the workflow inside ComfyUI
-
Heads up that I've created a public syslog server which can ingest logs from an iGate. It lets the user view their own logs as well as plots data on maps - including signal strength etc. This is purel…
-
### Your current environment
vllm version = 0.6.1
### Model Input Dumps
_No response_
### 🐛 Describe the bug
The output of `command:`
vllm version = 0.6.1. InternVLChat is in lis…
-
Hi,
I was reading through the documentation for [Using Lora in VLLM](https://docs.vllm.ai/en/latest/models/lora.html).
In the documentation when they start the server, it looks like they have t…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related iss…
-
### Your current environment
The output of `python collect_env.py`
I attempted to run that, but it threw errors. I'm running this in docker on Windows 11
### Model Input Dumps
_No response_…
-
### System Info / 系統信息
- vllm 0.5.3
- transformer 4.44.0
- torch 2.3.1
### Who can help? / 谁可以帮助到您？
@sixsixcoder @zr
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubunt…