Conversational threads for cost-saving & better readability

[rounakdatta]

Can we do Discord/Slack style conversation threads?

• Often referrring to a particular section in a past answer, I want to ask a follow-up question. And upon answers to that, there could be furthur follow-up questions. It would definitely be cost-effective if we could branch out (potentially infinitely nested threads!!??) so that we don't end up passing the entire conversation for completion to the OpenAI API.
• This could also better-organize the conversations. Looking back at an old conversations it'd be easier to follow given one-context per thread.

Here's an diagrammatic representation of what I mean:

[cogentapps]

I like this idea! It would need a good UI design for the threads, though.