noamgat / lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model
MIT License
1.42k stars 65 forks source link

RegEx for vLLM #25

Closed jpeig closed 10 months ago

jpeig commented 10 months ago

Is RegEx currently supported for vLLM?

The docs are currently unclear about it.

noamgat commented 10 months ago

Yes, it is. If you follow the example notebook but create a RegexParser instead of a JsonSchemaParser it will work.