XiangLi1999 / PrefixTuning

Prefix-Tuning: Optimizing Continuous Prompts for Generation
868 stars 158 forks source link

How to do inference with prefix tuning? #44

Closed JiaxiLi001 closed 2 months ago

JiaxiLi001 commented 1 year ago

I just don't know how to inference with prefix tuning, what prefix should I choose for the model(like gpt2) ?