Closed andrrizzi closed 1 year ago
Currently they auxiliary loss functions are saved in a normal list, but we could save them in a ModuleList. I think this way if the loss function has trainable parameters (e.g., a decoder for reconstruction losses) they will be optimized as well.
list
ModuleList
is this closed by the related commit?
Should be, but didn't work! Possibly the colon tripped GitHub up. Closing manually.
Currently they auxiliary loss functions are saved in a normal
list
, but we could save them in aModuleList
. I think this way if the loss function has trainable parameters (e.g., a decoder for reconstruction losses) they will be optimized as well.