Using OpenAI will allow an RPG Master to run a campaign with players handled by the AI. The main scope is educational, playing around with AI and vector database.
Caching embeddings result can allow to reuse response if we couldn't persist it the first time. Avoiding a call to create same embedding twice.
For how long we should keep it in cache? A day?
How we should create the cache key?
Caching embeddings result can allow to reuse response if we couldn't persist it the first time. Avoiding a call to create same embedding twice. For how long we should keep it in cache? A day? How we should create the cache key?