BGE-M3预训练问题 - Githubissues

FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs

MIT License

7.81k stars 569 forks source link

Open LLLiHaotian opened 6 months ago

LLLiHaotian commented 6 months ago

如果要基于自己的中英文文本数据，对BGE-M3模型进行RetroMAE的二次训练，是直接对xlm-roberta进行二次训练吗

staoxiao commented 6 months ago

We release the retromae version of bge-m3: https://huggingface.co/BAAI/bge-m3-retromae, and you can use it to do pretrain.