-
Thanks for publishing this customized version of vllm.
According to the readme.md, I tried to install it and found some problems.
The error message is as follows:
```
Building wheels for collecte…
-
### 🚀 The feature, motivation and pitch
Request for dynamic download of LoRA adapters from S3 or HF Hub based on what `model` adapter id is passed in the request.
### Alternatives
No alternatives …
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
I run this:
python3 test/test_e2e/launch_server.py
and get the following error:
File "/S-LoRA-main/slora/models/peft/lora_unordered_batch_infer.py", line 13, in
from slora._kernels import …
-
I'm running my ComfyUI as a server. I'm using the exact same workflow, and the only thing that changes is the model. Even though I'm using --highvram, the model is still partially reloading when I swa…
-
Hello,
I'd like to make networking independent from the packet forwarder app.
I see it happen in following steps:
- #18
- move network configuration handling to a separate file: wip: https://gith…
-
Gemini Nano weights from Google Chrome are on [HuggingFace](https://huggingface.co/wave-on-discord/gemini-nano). You can run the inference using this model with [MediaPipe LLM inference](https://githu…
-
I need to change the variable that I received by LoRa for to send to ThingsBoard, but there is a error. "invalid conversion from 'int' to 'const char*' [-fpermissive]"
Thank you!
```#include
#…
-
Hello!
My problem is that I am receiving a packet with name and value, but I need to separate these. I need to separate the "buff", the packet received is: Received packet 'Bovino20.00'. I would l…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
使用lmdeploy lite auto_a…