search

turboLJY / Transfer-Prompts-for-Text-Generation

16 stars 1 forks source link

Freeze PLM in PTG? #7

Open gaojingsheng opened 2 years ago

gaojingsheng commented 2 years ago

Hi, the idea of your paper is novel and I am interested in it. However, after I check your result, I found that PLM is not freezed in your PTG. You can see pic below, line44 in ptg.py means you will never freeze plm in ptg, which is not consistent with your description in your paper. After I freeze the PLM in your ptg, the result of personachat is: Bleu1: 31.69 Bleu2: 19.93 Distinct 1: 1.09 Distinct 2: 4.08. Hope your reply as soon as possible, thanks~

image
gaojingsheng commented 2 years ago

Also, i have reproduce the result of ptg( freeze PLM) in dailydialogue, the result is PTG real freeze plm cross-task-dd epoch: 5 DailyDialogue Bleu1: 22.10 Bleu2: 13.66 Distinct1: 3.01 Distinct2: 11.66 which seems to be too low