sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.27k stars 545 forks source link

[Bug] frequency penalty #2177

Open vivian0429 opened 4 days ago

vivian0429 commented 4 days ago

Checklist

Describe the bug

It seems there are some issue in the frequency_penalty implementation. image

Reproduction

code issue

Environment

skip

merrymercy commented 4 days ago

please help us fix it