junxnone / aiwiki

AI Wiki

https://junxnone.github.io/aiwiki

18 stars 2 forks source link

Hot LM Tuning PrefixTuning #411

Open junxnone opened 1 year ago

junxnone commented 1 year ago

Prefix Tuning

固定预训练模型参数，只对小部分可训练参数微调

Prefix-Tuning

P-Tuning V2

Reference

paper 2021 Prefix-Tuning Optimizing Continuous Prompts for Generation
paper 2021 P-Tuning v2 [Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks]()