-
Hello,I used Qlora to train,but I get an error:
NotImplementedError: Cannot copy out of meta tensor; no data!
requriements.txt:
```
peft @ file:///root/peft
torch==1.13.1+cu116
torchaudio==0.1…
-
- try with hugging face u-net
- try the artbench or cifar data with the HF pipeline to see how well that data can be learned and with how many samples needed.
-
-
### Describe the bug
using the train_dreambooth.py script, when I add flags for enabling xformers and set_grads_to_none, the following error happened: train_dreambooth.py: error: unrecognized argum…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.9.1.dev0
- Platform: Linux-5.15.0-107-generic-x86_64-with-glibc2.35
…
-
When i train diving-48 datasets with clip_base,i change videos_per_gps=4 because my machine limit(v100 32g). And i use 14 gpus to train a model so the batchsize is 56,close to 64.But finally i got top…
-
hyao1 updated
2 years ago
-
### Feature request
Context: https://github.com/huggingface/transformers/pull/29588#discussion_r1523510004
### Motivation
The layer-wise optimizers is not GaLore-specific. We could apply it t…
-
GAN training is currently broken. Pytorch Lightning also had the same issue described in detail: https://github.com/PyTorchLightning/pytorch-lightning/issues/591, https://github.com/PyTorchLightning/p…
-
It would be *really* cool if this extension made it possible to define a number of aspect ratio buckets that images are then cropped into (matching to the closest aspect).
Could make usage for grad…