search

PaddlePaddle / ERNIE

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
6.25k stars 1.28k forks source link

ernie_gen的对话任务相关疑问 #606

Closed lonelydancer closed 3 years ago

lonelydancer commented 3 years ago

背景:ernie_gen使用ernie-1.0初始化，做中文对话任务。 对话任务需要提供：role_type_size，我看默认是3，对应是user, bot, knowledge 1.如果我的任务不需要knowledge字段，ernie-1.0的pretrain model能复用么? 2.role_type我看是一问一答，支持用户连续说n个吗，即role_type连续几句都是0 3.ernie-1.0中的embedding表示（token/position/src_ids）要和ernie-gen 对话任务表示要是一样的吗

oyjxer commented 3 years ago
  1. 可以
  2. 可以吧用户连续说concat起来
  3. 是
lonelydancer commented 3 years ago

@oyjxer 你好。 对于问题3，ernie-1.0模型里好像并没有针对dialog数据的role embedding、turn_embedding等,这样就不一致了吧

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Feel free to reopen it. Thank you for your contributions.