-
qwen2-vl has always been memory hungry (compared to the other vision models) and even with unsloth it still OOMs when the largest llama3.2 11b works fine.
I'm using a dataset that has high resolution…
-
**Description**
The archiver should be integrated into the new architecture. To achieve this we will move the existing archivers from Operate and Tasklist to camunda-exporter, while merging them a…
-
I attempted to record the loss and learning rate of my lora learning, but only GPU information …
-
### Describe the bug
Encountered this error with zero information, when using 'train_dreambooth_lora_sdxl_advanced.py',
Traceback (most recent call last):
File "/usr/local/bin/accelerate", lin…
-
In class `LossView`:
```
def __init__(self, loss, batch_scheduler):
super().__init__()
self.batch_scheduler = batch_scheduler
# Gather updates from the optimizer and the bat…
-
I have followed the Sample Colab with my custom dataset ( < 100 samples ). With the same Configs as in the Sample Colab(loading the model in 4 bit and dtype as None and other configs like Peft and Tra…
-
**What you were expecting:**
I would like to notify user when `getPermissions` request is failing. To do it, I catch the error in `checkError` and I reject promise with `logoutUser: false` and withou…
-
I am trying to finetune dinov2 for image classification on a custom dataset (medical image dataset) with the objective of increasing accuracy. The problem is that when I use linear evaluation I get an…
-
### System Info
Hello I am trying to load Mistral-Nemo Instruct-2407 in bnb 4bit on 4 A10 gpus on ec2 instance.
I upgraded all the packages.
Still I face cuda memory out of error when train batc…
-
@Yuliang-Liu Nice work! I run into finetune issue as follows
2 GPUs of NVIDIA A8…