search

noamgat / lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model
MIT License
1.42k stars 65 forks source link

TensorRTLLM #101

Closed diandianliu closed 4 months ago

diandianliu commented 4 months ago

Hi, Does LM-Format-Enforcer support the Qwen model using TensorRTLLM for inference? If so, where can I find tutorials or examples?"