-
Adamw was replaced by a new optimization method - **diffgrad**. What do you think about it? Will you add it to increase the accuracy in the experiment?
**Change**
```
optim_g = torch.optim.Ad…
-
In both of the jupyter notebooks and the paper, I noticed that instead of using Adam, the most commonly used optimizer for transformers, you used Adagrad for all of the experiments. Is there a reason …
-
I tried it in two tasks, but got nans during training, any suggestions?
-
Hi!
I have some issues understanding the size scheduling. I care about it because in one of my projects I try to create an [audio-visual mirror](https://github.com/NotNANtoN/AuViMi). There I need t…
-
When I do tts fintuing using jvs recipe. I finished stage1-5, but in stage 6, When I using recommeded command :
$ ./run.sh --stage 6 --train_config conf/tuning/finetune_tacotron2.yaml \
--train_…
-
I think Huggingface's Dreambooth is the only popular SD implementation that also uses Prior Preservation Loss, so I've been motivated to get it working, but the results have been terrible, and the ent…
-
Hello, I'm really appreciate your work. But now I wonder how to use GPU to train the model. There are always mistakes when I use the CUDA device. Thanks a lot.
`device = torch.device('cuda' if use_cu…
-
微博内容精选
-
Hi,
I followed your tutorial on youtube, worked great the first time without any problems.
I closed the Anaconda prompt, and after this nothing worked and I got multiple messages like this :
`(vqga…
-
Based on [SO post](https://stackoverflow.com/q/70740565/17840900).
Goal: Amend this [Notebook][1] to work with **albert-base-v2** model
Kernel: `conda_pytorch_p36`.
**Section 2.1** exports th…