search

mindspore-lab / mindnlp

Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of 🤗Huggingface.
https://mindnlp.cqu.ai/
Apache License 2.0
702 stars 197 forks source link

急切需要中文embedding模型适配需求（bge-large-zh和bge-reranker-large） #747

Closed zhangmeide closed 12 months ago

zhangmeide commented 12 months ago

我们需要在910B上训练和推理以下中文embedding模型： https://huggingface.co/BAAI/bge-large-zh https://huggingface.co/BAAI/bge-reranker-large

能否适配一下，谢谢！

lvyufeng commented 12 months ago

直接使用BertModel.from_pretrained('BAAI/bge-large-zh', from_pt=True)即可