search

AkeruAI / akeru

Akeru is an open source AI platform built on top of the Akeru AI edge network. The network runs as a Bittensor Subnet, providing a transparent, safe and highly available AI capacities.
https://www.akeru.ai/
83 stars 16 forks source link

Add Semantic Cache To Handle Requests Made By Validators #104

Closed tobySolutions closed 5 months ago

tobySolutions commented 6 months ago

Semantic Cache will be something that is a great nice to have for the backend, because as this becomes a big system more and more requests will be made and having a proper caching system for memoization will be great!

To see more about Semantic Cache: https://github.com/upstash/semantic-cache

tobySolutions commented 6 months ago

Working on a POC that we ca eventually add to the API with @GuiBibeau.

multipletwigs commented 5 months ago

Since we're no longer working on bittensor related models, we will be closing this issue!