Track multiple and swap easily between contexts

[getnamo]

NB: context meaning full prompt history

• [ ] Swap contexts without tearing down thread and re-starting
• [ ] Flush contexts to and from disk utility
• [ ] Enable rollback of single prompt entries (e.g. regenerate concept)
• [ ] Impersonate syntactic sugar

[getnamo]

Likely need some form of batched inference with different contexts: https://github.com/ggerganov/llama.cpp/tree/master/examples/batched-bench

NB:

• [ ] Refactor to wrap chat contexts as a list/map of chat name -> chat context + history with ability to rollback replies for e.g. regeneration