search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.98k stars 2.92k forks source link

[Question]: rocketqa-zh-dureader-query-encoder和rocketqa-zh-base-query-encoder模型有什么区别 #6015

Closed gyl1993 closed 3 months ago

gyl1993 commented 1 year ago

请提出你的问题

rocketqa-zh-dureader-query-encoder和rocketqa-zh-base-query-encoder模型有什么区别，哪里有文档介绍这两个模型？

w5688414 commented 1 year ago

rocketqa-zh-base-query-encoder是基于ERNIE 3.0训练的 rocketqa-zh-dureader-query-encoder 是基于ERNIE 1.0训练的

gyl1993 commented 1 year ago

rocketqa-zh-base-query-encoder是基于ERNIE 3.0训练的 rocketqa-zh-dureader-query-encoder 是基于ERNIE 1.0训练的

谢谢，有说明文档吗

w5688414 commented 1 year ago

rocketqa-zh-base-query-encoder是基于ERNIE 3.0训练的 rocketqa-zh-dureader-query-encoder 是基于ERNIE 1.0训练的

谢谢，有说明文档吗

https://github.com/PaddlePaddle/PaddleNLP/blob/develop/pipelines/benchmarks/README.md

gyl1993 commented 1 year ago

rocketqa-zh-base-query-encoder是基于ERNIE 3.0训练的 rocketqa-zh-dureader-query-encoder 是基于ERNIE 1.0训练的

判断两句话语义是否相同预训练模型用rocketqa-zh-base-query-encoder效果更好吧，有更好的预训练模型推荐吗？

gyl1993 commented 1 year ago

rocketqa-zh-base-query-encoder训练用的RocketQA，还是RocketQAv2呢

w5688414 commented 1 year ago

RocketQA， 判断两句话是否语义相同可以用simBERT，RocketQA主要是用在搜索场景