add support for torch_compile with HF models

eth-sri / lmql

A language for constraint-guided and efficient LLM programming.

https://lmql.ai

Apache License 2.0

3.48k stars 191 forks source link

Closed Saibo-creator closed 3 months ago

Saibo-creator commented 4 months ago

addressing #283

lbeurerkellner commented 3 months ago

Awesome, this seems to work well during testing. Thank you for the contribution :)