Caching Fix - Githubissues

parkervg / blendsql

Query language for blending SQL logic and LLM reasoning across structured + unstructured data. [Findings of ACL 2024]

https://parkervg.github.io/blendsql/

Apache License 2.0

72 stars 4 forks source link

Closed parkervg closed 7 months ago

parkervg commented 7 months ago

This PR fixes some bugs/edge cases with the implementation of the diskcache cache for model predictions.

program_to_str() updated, tracks global variables via ast to avoid unintended retrievals from cache
caching: bool argument added to Model class
- Allows user to toggle caching behavior off
Caching test cases added

Closes #8