Closed 321hallelujah closed 3 years ago
hi, when training in self-supervised and fine-tune stage. your work dont use softmax after linear layer, which some other related work is used. So,my question is,: In training, what is the difference when softmax is applied or not. Best wishes.
We use the "nn.CrossEntropyLoss()" which combines nn.LogSoftmax() and nn.NLLLoss() in one single class.
hi,
when training in self-supervised and fine-tune stage. your work dont use softmax after linear layer, which some other related work is used. So,my question is,: In training, what is the difference when softmax is applied or not. Best wishes.