kipgparker / soft-prompt-tuning

MIT License
334 stars 44 forks source link

Input clarification from example #8

Closed JosephGatto closed 2 years ago

JosephGatto commented 2 years ago

To clarify, the line

torch.full((1,n_tokens), 50256)

Would be replaced with our prompt when training, correct?