search

uiuc-focal-lab / syncode

Efficient and general syntactical decoding for Large Language Models
MIT License
200 stars 16 forks source link

Make opp a command-line flag and member of HuggingFaceModel. #122

Closed pmfirestone closed 4 weeks ago

pmfirestone commented 4 weeks ago

This flag causes us to use opportunistic decoding.