harrisonvanderbyl / rwkvstic

Framework agnostic python runtime for RWKV models
https://hazzzardous-rwkv-instruct.hf.space
MIT License
145 stars 18 forks source link

Sample with repetition penalty #20

Open fermian opened 1 year ago

fermian commented 1 year ago

Is there currently any way to sample tokens with a repetition penalty?