Closed silkinresearch closed 2 years ago
Hi,
You cannot directly load another pre-trained model in the SimCSE repo (it can only load either our trained models or your own trained models). You can train rubert following our training guideline and then load the trained model through the simcse package.
Ok. Thank you for your response. Everything is clear now 🙂
I tried to use SimCSE with BERT from Hugging Face, that is suitable for Russian Language. (https://huggingface.co/DeepPavlov/rubert-base-cased)
I wrote following code, that is provided in your WIKI: Load-SimCSE-Models.
The problem is the embeddings are calculated in less than a second, that is very strange. The result of using such embeddings works slightly better than random algorithm. At the same time https://www.sbert.net/ can deal with the BERT and shows satisfactory results.
Did I get embeddings with SimCSE correctly or not?