median-research-group / LibMTL

A PyTorch Library for Multi-Task Learning
MIT License
1.98k stars 185 forks source link

Question about AlignedMTL #57

Closed junyizeng closed 1 year ago

junyizeng commented 1 year ago

Thank you very much for updating Aligned MTL. After comparing your experiments with the paper, I have a question regarding the pseudocode in the first image. In the pseudocode, 'w' represents the weight for each loss function. However, in your code, you directly sum over 'B' in the 'alpha' code. I was wondering if you assume that the weights for each task are equal when writing the code? image image

Baijiong-Lin commented 1 year ago

The original code of AlignedMTL does not use $\omega$ (refer to https://github.com/SamsungLabs/MTL/blob/master/code/optim/aligned/solver.py).

Baijiong-Lin commented 1 year ago

Closed as no further updates.