-
hi! i have tried the pytorch-PCGrad in my project. my network was an mobilenetv2 followed by two task-head and these two task-head have different parameters. when i ran the pytorch-pcgrad, it went wr…
-
Hi, thanks for your work!
I'm wondering whether this repository supports amp? or how can I do it?
-
Setting reduction = 'sum' does not work because of [this line](https://github.com/WeiChengTseng/Pytorch-PCGrad/blob/e987ac603fa1accd386820a985a6dc2fd92dec5b/pcgrad.py#L58):
```
if self._reduction…
-
Thanks for the simple and elegant implementation!
I tried running your code as is, on Multi-MNIST data, and failed to reproduce results.
I ran main_multi_mnist.py without changing any hyper paramet…
-
Nice work!
When I changed some code of your work, I met "raise ValueError("Found nans in similarity matrix!")". How can I solve it?
Thank you!
-
Hi,
Your work looks very interesting. I was wondering if you have an update as to when you will release the PyTorch version of the code (you had mentioned mid June).
Thanks!
-
Hi, I'm trying to use PCGrad, but I'm having trouble with this gradient different type error. This error occurs in line number 80 in pcgrad.py.
If I make grads[idx].to(torch.bfloat16) to match…
-
I just noticed PCGrad in the list of optimizers modifiers. I had used this with success in the past on a very specific task. It may be useful.
RotoGrad: Gradient Homogenization in Multitask Learni…
-
-
Hi, I use it in my task, it happens the following errors. Does it support distributed training?
```
2021-03-19 12:13:41 ===> Epoch: 0_Iter:0 seg_loss: 2.94329 cls_loss: 0.63079 || 1:0.0272 | 2:0.…