Is Caching documented? - Githubissues

guidance-ai / guidance

A guidance language for controlling large language models.

MIT License

18.72k stars 1.03k forks source link

Open prescod opened 9 months ago

prescod commented 9 months ago

I cannot find documentation for how the query cache works.

tshu-w commented 9 months ago

After searching the code, I think the cache logic is not implemented in the refactored version, at least in the Remote Model. @slundberg

adamgordonbell commented 8 months ago

Oh, caching is gone now. I didn't realize that. Is it likely to reappear or should I layer caching on top in my specific solution?

Update: Created PR #603