search

voidKandy / espionox

Use espionox to streamline making LLM applications in Rust
https://crates.io/crates/espionox
10 stars 0 forks source link

Observation Mode Feature #13

Closed voidKandy closed 7 months ago

voidKandy commented 10 months ago

My first instinct is to decouple All mechanisms associated with memory: CachingMechanism, RecallMode, etc.. from the actual storage of memory: MessageVector. After that I think Observation modes could be a good addition to whatever struct would contain the mechanisms.

Observations would be made optionally before and after prompting. Observing any input or output to prompting could be a good way to create point of control over context.

voidKandy commented 7 months ago

I think the summarizer, observer, and memory stream implementation might have the same solution...Cooking on this currently

voidKandy commented 7 months ago

Observer field from Agent is going to be removed, as well as CachingMechanism and RecallMode from Memory. This means that the builder pattern for memory should also be removed and a new initialization protocol should be implemented

voidKandy commented 7 months ago

I am closing this because I am moving current issues to the v0 milestone