Sample with repetition penalty

harrisonvanderbyl / rwkvstic

Framework agnostic python runtime for RWKV models

https://hazzzardous-rwkv-instruct.hf.space

MIT License

144 stars 18 forks source link

Open fermian opened 1 year ago

fermian commented 1 year ago

Is there currently any way to sample tokens with a repetition penalty?