search

enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
https://big-agi.com
MIT License
5.14k stars 1.16k forks source link

[BUG] Chat titles are incorrect #234

Closed peperunas closed 6 months ago

peperunas commented 9 months ago

Describe the bug A clear and concise description of what the bug is.

Where is it happening?

To Reproduce Start a chat, read the chat title.

Screenshots / context

image

The title also have nothing to do with the conversation.

enricoros commented 9 months ago

Good job - sounds like prompts for chat titles are llm-dependent, and ollama needs some other sort of encoding/prompting. Remember which model in Ollama? (not necessary for the ticket, just a curiosity)

enricoros commented 8 months ago

Note that we are now using the Ollama /chat API, which has improved the encoding of the prompt. Now models shall have no issues with titles anymore.

enricoros commented 8 months ago

Please let me know if this is correct. I believe this should be the case now.

peperunas commented 7 months ago

It works, thank you!

Giulio De Pasquale

PhD Candidate in Program Analysis for Computer Security King’s College London, Strand Campus

Website: https://pepe.runas.rocks On 28 Dec 2023 at 10:42 +0000, Enrico Ros @.***>, wrote:

Please let me know if this is correct. I believe this should be the case now. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

enricoros commented 6 months ago

Nice! Probably the only obscure part is that Chat Titles are generated with the currently selected "functions" model (could be a local llm or cloud llm). Performing the selection of the "function" model is very opaque still.