noamgat / lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model
MIT License
1.42k stars 65 forks source link

Allow regex to exit to forcestopparser when receiving a pad/eos token after having been in a final state. #87

Closed JoshC8C7 closed 5 months ago

JoshC8C7 commented 5 months ago

See #86

Tests pass locally. TBC why this didn't affect all models?

noamgat commented 5 months ago

Thanks!