BGE-M3预训练问题 - Githubissues

FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs

MIT License

6.72k stars 480 forks source link

Open LLLiHaotian opened 3 months ago

LLLiHaotian commented 3 months ago

如果要基于自己的中英文文本数据，对BGE-M3模型进行RetroMAE的二次训练，是直接对xlm-roberta进行二次训练吗

staoxiao commented 3 months ago

We release the retromae version of bge-m3: https://huggingface.co/BAAI/bge-m3-retromae, and you can use it to do pretrain.