Open FergusFettes opened 6 days ago
Oh, I also changed the way 'llm --continue' works. Currently it tracks the conversation with the most recent start time. I found it much more helpful to track the conversation that has the most recent generations.
Sometimes it would be nice to step back a single generation. To fix a typo or redo a generation. This PR makes that possible. This is done by adding a parent ID to the responses and adding a table to track the HEAD ID.
I can clean it up and add some tests, but first I wanted to check if this was something you would be amenable to.
Here is a demonstration of what it allows for:
I think this is useful on its own and not too big of a change. However, this would also make it possible to explore many branches of a conversation in parallel, in a loom-like manner. I would make that as an additional module, but for that to be possible the responses need parent ids, so at least that much would have to be added to the db I believe.