josephrocca / OpenCharacters

Simple little web interface for creating characters and chatting with them. It's basically a single HTML file - no server. Share characters using a link (character data is stored within the URL itself). All chat data is stored in your browser using IndexedDB. Currently supports OpenAI APIs and ~any Hugging Face model.
https://josephrocca.github.io/OpenCharacters
MIT License
364 stars 60 forks source link

Feature request: Log how well each memory/lore query has been fulfilled #65

Open kickahaota opened 1 year ago

kickahaota commented 1 year ago

I'm have no idea whether this request is possible given the embedding API, but I'll ask anyway. :)

The logging code currently logs all the memory/lore queries that will be passed to the embedding API. It then logs the score of each memory/lore entry. But it would be very nice if it could also log how well each of the individual memory/lore queries were satisfied. In other words, it would be nice to be able to look at the log and say "The memory/log data contained extremely useful information for this query term, but no useful query information for this other term; so I should think about writing a memory or lore entry for that other term."