Hyperparameters for prompt tuning (v1) and fine tuning

THUDM / P-tuning-v2

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

Apache License 2.0

1.97k stars 201 forks source link

Open adam-dziedzic opened 1 year ago

adam-dziedzic commented 1 year ago

Thank you for your great work! What hyperparameters (number of epochs, lr, etc.) did you use for prompt tuning (v1) and fine tuning?