search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
130 stars 37 forks source link

Constrained decoding #302

Open kchatr opened 4 months ago

kchatr commented 4 months ago

Created a Truss for constrained decoding to facilitate a JSON mode using Hermes 2 Pro and Jsonformer for JSON generation based on a provided schema.