salesforce / GeDi

GeDi: Generative Discriminator Guided Sequence Generation
https://arxiv.org/abs/2009.06367
BSD 3-Clause "New" or "Revised" License
208 stars 46 forks source link

Details of evaluation #16

Open GinaJihyeonLee opened 2 years ago

GinaJihyeonLee commented 2 years ago

Which max_length do you use for the evaluation? (e.g., ppl, toxicity classifier) Did you truncate one or two sentences from whole generated texts? or roughly just use whole texts which include eos token?