uiuc-focal-lab / syncode

Efficient and general syntactical decoding for Large Language Models
MIT License
198 stars 16 forks source link

Decouple infer and evaluation #100

Closed shubhamugare closed 3 months ago

shubhamugare commented 3 months ago

It is a somewhat big refactoring to clean up the main part of the code in infer.py. The function infer intended for external API use and function evaluate which is useful for evaluating SynCode on standard datasets is decoupled.