Disallow empty generation

uiuc-focal-lab / syncode

Efficient and general syntactical decoding for Large Language Models

MIT License

198 stars 16 forks source link

Closed shubhamugare closed 2 months ago

shubhamugare commented 2 months ago

Disallows empty generation (this was observed in recent Gemma-2 update)