noamgat / lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

MIT License

1.01k stars 46 forks source link

Closed jlia0 closed 7 months ago

jlia0 commented 7 months ago

Since gpt-3.5-turbo-instruct and new releases on gpt-4-turbo, is it possible to use lm-format-enforcer with these models?

noamgat commented 7 months ago

As stated in the readme:

Known issues and limitations

LM Format Enforcer requires a python API to process the output logits of the language model. This means that until the APIs are extended, it can not be used with OpenAI ChatGPT and similar API based solutions.