search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
21.99k stars 1.26k forks source link

feat: Thread titles should auto-summarize Topic #979

Closed dan-homebrew closed 6 months ago

dan-homebrew commented 9 months ago

image

Our current Jan results in "New Thread" for each thread, as users don't title each thread manually.

We should find a way to implement a ChatGPT-style Thread Title summarizer, using the underlying LLM (prompt?)

hahuyhoang411 commented 9 months ago

I thought about this before. But don't know how it should work. Maybe we can pre-download Tinyllama for users, and then we can use it as a title maker?

hiro-v commented 9 months ago

We can use the existing model for summarizing threads message after the first question/ answer pair and fill out the thread. Do not need to use another model.

0xgokuz commented 8 months ago

Hi @dan-jan, I'm taking on this task

imtuyethan commented 7 months ago

@0xgokuz Hi, can I check how's the progress of this task?

0xgokuz commented 7 months ago

@0xgokuz Hi, can I check how's the progress of this task?

Hi @imtuyethan - I'm going to clean up the solutions, and going through it one more time before requesting another PR. Hopefully I can get that sorted this week / next latest.

Van-QA commented 7 months ago

hi @0xgokuz, thank you for your contribution,

While testing the generated thread title, occasionally the title is too long, which can cause inconvenience for users, could we establish a restriction on the thread titles generated to guarantee they are brief and user-friendly? (e.g. around 10 words, etc...)

image

cc: @louis-jan

0xgokuz commented 7 months ago

@Van-QA it's very dependent on the model that you're using actually. I noticed that the title is significantly cleaner if you're using GPT4. Try it out.

Van-QA commented 6 months ago

Tested and looking good on Jan v0.4.6-273 ✅