AlibabaResearch / DAMO-ConvAI

DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.
MIT License
1.21k stars 186 forks source link

Space-3 Pre-trained Checkpoint #11

Closed FlashCoding closed 1 year ago

FlashCoding commented 1 year ago

Hi,

Thanks for your great and exciting work! I have a question about the pre-trained checkpoint: Is the SPACE-3 pre-trained checkpoint released in this repo based on the full-shot setting? If I want to reproduce the few-shot setting results, do I need to pre-train the model from scratch with only "10% of the training data of the target evaluation dataset if it exists in the AnPreDial."

Thanks!

HwwAncient commented 1 year ago

Hi,

Thanks for your great and exciting work! I have a question about the pre-trained checkpoint: Is the SPACE-3 pre-trained checkpoint released in this repo based on the full-shot setting? If I want to reproduce the few-shot setting results, do I need to pre-train the model from scratch with only "10% of the training data of the target evaluation dataset if it exists in the AnPreDial."

Thanks!

Yes, you‘re right. The released SPACE-3 pre-trained checkpoint is only based on the full-shot setting.