-
I am running SwarmUI and ComfyUI on the same node, a windows host. I already have models, loras and all the things downloaded and in use by ComfyUI, so in Server -> Server Configuration i followed the…
-
### Your current environment
INFO 11-05 12:03:00 engine.py:290] Added request chat-58cc8fe807d34717b775ea663d913bcb.
ERROR 11-05 12:03:00 client.py:250] RuntimeError('Engine loop has died')
ERROR 1…
-
steps: 0%| | 0/234 [00:00
-
Hi all,
I want to establish multicast communication between chirpstack server and WIO-e5 mini modules.
Currently as a test base I'm using Lorawan-end-node. Unicast communication in class C works p…
-
I've trained the `unsloth/Llama-3.2-3B-Instruct-bnb-4bit` model successfully, but when I try to use it with `astLanguageModel.from_pretrained`, I get this error:
```
Traceback (most recent call la…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
**Describe the bug**
It's frustrating to run i.e. `ilab -v data generate` only to get:
```
...
DEBUG 2024-09-12 13:23:22,053 instructlab.model.backends.vllm:205: vLLM serving command is: ['/opt/…
-
Here is the development roadmap for 2024 Q4. Contributions and feedback are welcome ([**Join Bi-weekly Development Meeting**](https://t.co/4BFjCLnVHq)). Previous 2024 Q3 roadmap can be found in #634.
…
-
KubeAI should be able to serve dynamically loaded LoRA adapters. Eventually KubeAI could produce these adapters through supporting a finetuning API endpoint, however that can be implemented separately…
-
### 🚀 The feature, motivation and pitch
Request for dynamic download of LoRA adapters from S3 or HF Hub based on what `model` adapter id is passed in the request.
### Alternatives
No alternatives …