Only use first question and response for title generation

Technoculture / echoes

For collaboration between R&D teams and AI agents

https://www.echoes.team/

MIT License

6 stars 1 forks source link

Only use first question and response for title generation #4

Closed sutyum closed 11 months ago

sutyum commented 11 months ago

Currently the title generation uses too many tokens because it sends the entire chat. Chat titles should ideally be generated after the response to the first chat query response, using just the first chat interaction with a cheap model (GPT3.5 or cheaper (replicate))

PrinceBaghel258025 commented 11 months ago

chat title generation is only using first prompt and response.
will use another model from replicate

sutyum commented 11 months ago

You should try to improve the prompt so it always gives titles of the form "Title: Subtitle"