search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
30.71k stars 4.47k forks source link

[Issue]: How can I disable caching? #3153

Open tyler-suard-parker opened 1 month ago

tyler-suard-parker commented 1 month ago

Describe the issue

In client.py, there is a function where a database is created for caching. I am running my AutoGen code on a machine without any file/folder creation privileges, so I am getting an error when AutoGen tries to create a database for caching. How can I turn caching off?

Thank you.

Steps to reproduce

  1. Use Azure Web Apps
  2. Deploy some AutoGen code to the web app
  3. Run it

Screenshots and logs

image

Additional Information

No response

tyler-suard-parker commented 1 month ago

I found the answer, add "cache_seed": None, to the LLM config.

tyler-suard-parker commented 1 month ago

Ok I just looked at my llm_config and it already had the cache seed set to none. How do I turn off caching?

Hk669 commented 1 month ago

https://microsoft.github.io/autogen/docs/topics/llm-caching/#disabling-cache

@tyler-suard-parker this should help.