hao-ai-lab / LookaheadDecoding

Apache License 2.0
1.04k stars 63 forks source link

Do lookahead and repetition_penalty conflict? #55

Open zhanweiw opened 3 months ago

zhanweiw commented 3 months ago

After enabled repetition_penalty, will it lower lookahead's probability? If yes, any solution for avoiding the conflict?