XiangLi1999 / PrefixTuning

Prefix-Tuning: Optimizing Continuous Prompts for Generation
868 stars 158 forks source link

About prefix tuning input #11

Open danilproger opened 2 years ago

danilproger commented 2 years ago

Hi, Lisa! I read in your paper that you have tried different inputs for prefix like 'random init', 'active', 'summarize', etc. I would like to ask in what form did you apply words to the input to the prefix? Were these tokenized words or smth else?