NeonGeckoCom / neon-llm-core

Core Neon LLM Connector
Other
0 stars 0 forks source link

[FEAT] Event-driven persona updates #8

Open NeonDaniel opened 6 days ago

NeonDaniel commented 6 days ago

Objective

Rather than periodic synchronization (or maybe in addition), could PersonasPrivoder handle update events emitted by whatever service is defining new personas?

Initial Implementation Requirements

Other Considerations

With more focus on BrainForge LLMs, a larger portion of the LLMs will have a static list of personas defined for that specific LLM, rather than a mutable list of user-defined personas.

NeonKirill commented 6 days ago

@NeonDaniel sounds good to me, the only edge case issue I may think of is to make sure we acquire the up-to-date list of personas on the startup, so I would suggest to keep initial + polling synchronization, and add the proposed event-driven update. We may set this polling interval high enough so it wont affect performance but will ensure system stability