Thread summary: Summarise a thread in Sphinx

stakwork / sphinx-mac

Sphinx app for mac desktop

MIT License

4 stars 16 forks source link

Thread summary: Summarise a thread in Sphinx #200

Open tomsmith8 opened 10 months ago

tomsmith8 commented 10 months ago

thread summary: Pass the text of a thread and summarise it’s current status

Press summarise button
Sends content to Stakwork
Summarises text
Returns it back to the app
Displays to user (should we store it or should it be one-time disposable)

Example response: Ed started the thread by asking about a problem with using a twitter API key for Kevin. Ali and Gonzalo tested and the current thinking is that the key is invalid, they are on a call to discuss.

uncleJim21 commented 10 months ago

I'd like to take this one when it's ready. I would add that there are definitely some question marks around the design but I can create a prototype of the logic pretty quick using my GPT 4 API key

uncleJim21 commented 10 months ago

I have a prototype I built of this just using ChatGPT. But for privacy I think it's best if we can run through our own private LLM or at least anonymize through a larger anonymity set. Let me know who will be assigned to creating the API and I'll work with them to define requirements @tomsmith8

tomsmith8 commented 10 months ago

@uncleJim21 yeah agreed. Using our LLaMa model (self-hosted) might make the most sense for privacy reasons. The only downside right now is it takes a little while to process (sometimes a few mins).

Cool will do!