-
### Describe the issue
# Issue:
After tens of batches, OOM shows when I try to fine-tune LLaVA 1.5 on single A100 w/ QLoRA and cpu-offloading.
# Command:
```
MODEL_DIR=""
wget -P $MODEL_DIR \
…
-
Hello ! I am using Kaisen Linux, a debian-based sysadmin oriented distro. Can you provide support for it ? It would be super nice !
-
### Version
Microsoft Windows [Version 10.0.22000.556]
### WSL Version
- [X] WSL 2
### Kernel Version
5.10.60.1
### Distro Version
Ubuntu 20.04
### Repro Steps
1. Install …
-
Hi team,
Here are a few improvements/optimizations I've in mind for the rtOptimizer plugin.
- Selective whitelisting from concatenation
- Currently, all of the JS is being removed from the JS…
-
Great project. In terms of deployment, it would be very useful to be able to use an inference device on a Pi like the Intel Neural Compute Stick 2. This would offload inference from the Pi thus avoidi…
-
Lets make this generic question about how hard would be to make CQENGINE distributed, so we can offload large amount of data for fast queries?
I have found some discussion from 2014 at googlegroups…
-
Found on this code versions: https://github.com/huggingface/transformers/commit/52585019a17f6033df64e6ad4222d22a1f993c61, https://github.com/huggingface/accelerate/commit/12a007d55937345aa986f5d7b1a1…
-
Dota failing to launch after the most recent update (Major update with compendium)
![DotaVulkanIssue](https://github.com/user-attachments/assets/1ec4ff7c-d464-4539-8a67-b3c4b7991457)
-
The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the…
-
**Describe the bug**
I git cloned the repo on my headless server, modified the configuration in docker-compose.yml to point to my public IP address and port forwarded port 3000, 3001 and 4000 (just f…
r2fo updated
4 months ago