search

dbiir / UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
https://github.com/dbiir/UER-py/wiki
Apache License 2.0
3.01k stars 525 forks source link

Does finetune/run_simcse.py only support unsupervised training? #312

Open Eric8932 opened 2 years ago

Eric8932 commented 2 years ago

During training, the tgt of the loss function is torch.arange(batch_size), which is suitable for unsupervised training. But this will overwrite the labels of the supervised training set.

ydli-ai commented 2 years ago

For now, we only implemented the unsupervised part of simcse. If you are interested, you can contribute your code and open a PR.