fastnlp / CPT

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
481 stars 70 forks source link

生成模型预测出的结果跟输入一模一样? #53

Closed zhihao-chen closed 1 year ago

zhihao-chen commented 2 years ago

基于CPT-Large模型finetune CPTForConditionalGeneration之后,预测出的结果跟输入一模一样。这是为什么呢?decoder的输出跟输入是一模一样的