-
-
## Issue description
It is easy to introduce an extremely nasty bug in your code by forgetting to call `zero_grad()` or calling it at the beginning of each epoch instead of the beginning of each it…
-
**Describe the bug**
I implement multiple transformer layers with only one-layer parameter (e.g., recursively use one layer six times to construct a 6-layer transformer), when I use activation checkp…
-
I have a RTX 3080. It keeps giving me a "Requires GPU error"
```
The following values were not passed to `accelerate launch` and had defaults used instead:
`--num_cpu_threads_per_process`…
-
Are there any guidelines, when to use the `wp.tape` or the `adjoint=True` argument to compute gradients?
There are two examples of a `torch.autograd.Function` in this repository using different appro…
-
- try with hugging face u-net
- try the artbench or cifar data with the HF pipeline to see how well that data can be learned and with how many samples needed.
-
GAN training is currently broken. Pytorch Lightning also had the same issue described in detail: https://github.com/PyTorchLightning/pytorch-lightning/issues/591, https://github.com/PyTorchLightning/p…
-
### Describe the bug
using the train_dreambooth.py script, when I add flags for enabling xformers and set_grads_to_none, the following error happened: train_dreambooth.py: error: unrecognized argum…
-
Hello,I used Qlora to train,but I get an error:
NotImplementedError: Cannot copy out of meta tensor; no data!
requriements.txt:
```
peft @ file:///root/peft
torch==1.13.1+cu116
torchaudio==0.1…
-
Please. help . I have already tried everything possible, but the training gives this error