search

Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
5.94k stars 409 forks source link

Cache Management via UI #136

Open ranjancse26 opened 8 months ago

ranjancse26 commented 8 months ago

I think it's a good idea for letting the users manage their cache on the UI. Currently, there's no such UI feature exists for the users to say clear or reset or visualize cache etc. Please decide on the minimum cache management features that could be exposed so they could easily manage from the Portkey UI.

Enterprise Customers would need more, for example, have the cache managed on their preferred vector databases. Hope you do agree and consider extending the cache management and configurability options.

ayush-portkey commented 8 months ago

Hi @ranjancse26,

Completely agree with your points. Happy to mention that we have these things on our roadmap. I don't have any timelines to share right now but I'll update here once it gets added to a sprint.