google-research / mixmatch

Apache License 2.0
1.13k stars 163 forks source link

Hello, can I use it for multi label classification? If so, what should I pay attention to in the process of tag prediction? For multi label classification, sigmoid is generally used as the loss function. In this case, can you change your loss function to sigmoid? #39

Closed ghost closed 3 years ago

ghost commented 3 years ago

Hello, can I use it for multi label classification? If so, what should I pay attention to in the process of tag prediction? For multi label classification, sigmoid is generally used as the loss function. In this case, can you change your loss function to sigmoid?

david-berthelot commented 3 years ago

We didn't MixMatch in this setting. One could see a multi-label classification loss as multiple binary losses to model the problem in a compatible way with MixMatch. I guess I can't really give more advice than that and experimenting with the code on your data.

ghost commented 3 years ago

Thank you for your reply. I used my own multi classification dataset (not multi label classification) to train mixmatch. The first few rounds of training worked well,after the first few epochs of network learning, the loss began to rise, the precision decreased, and many parameters were adjusted. Could this be due to the label prediction error of unlabeled samples, which led to the worse training effect of the model?

david-berthelot commented 3 years ago

It could be a lot of things, it's hard for me to tell. This repository is mostly to show how to reproduce the results achieved in the paper.