Dan-wanna-M / formatron

Formatron empowers everyone to control the format of language models' output with minimal overhead.
MIT License
163 stars 6 forks source link

Integrate more third-party libraries #5

Open Dan-wanna-M opened 3 months ago

Dan-wanna-M commented 3 months ago

~- [ ] TGI~ They do not offer a custom logits processor and according to the issues/PRs they do not want to support it, at least for now ~- [ ] lmdeploy~ They do not offer a custom logits processor either and I am waiting for their reply on the possibility of this feature ~- [ ] MLC-LLM~ They do not offer a custom logits processor and according to the issues/PRs they do not want to support it, at least for now