defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
485 stars 52 forks source link

Remove dependency on AutoTokenizer in api_runner #115

Closed rishsriv closed 3 months ago

rishsriv commented 3 months ago

This is to ensure that the api runner can be easily used on machines where a tokenizer has not yet been downloaded, or transformers