Fix the Jump-Forward with Chinese

sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.

https://sglang.readthedocs.io/en/latest/

Apache License 2.0

5.36k stars 388 forks source link

Closed hnyls2002 closed 3 months ago

hnyls2002 commented 3 months ago

This PR fixes #549 and upgrades the Outlines version to 0.0.44.

outlines=0.0.43 has the problem of a numba bug https://github.com/outlines-dev/outlines/pull/930
It solves this using a leading \x00 at each byte.