i-dot-ai / redbox

Bringing Generative AI to the way the Civil Service works
https://i-dot-ai.github.io/redbox/
MIT License
83 stars 27 forks source link

[REDBOX-496/498] Make the default route go to chat with LLM; chat with or without documents #778

Closed andy-symonds closed 1 month ago

andy-symonds commented 1 month ago

Context

As the first step of making chat more widely available to users, the default route should be changed to chat. In addition, the chat route now has logic to tell if no documents are selected chat_no_docs which results in sending question to GPT model or if a document is selcted, chat_with_docs, the document is stuffed into the context window along with the users' question.

Changes proposed in this pull request

Change default route to chat. Summarise and RAG functionality can still be accessed using keywords as seen in this screenshot

Screenshot 2024-07-12 at 17 05 39

Chat as default is split into chat no documents:

chat-no-docs

and chat with documents:

chat-with-docs

Guidance to review

Please review and check that you are happy with the approach to selecting chat with documents or chat with no documents?

Relevant links

Things to check

lmwilkigov commented 1 month ago

@andy-symonds Had a chat with Charlotte and demoed this branch. We think we should rename @chat_no_docs to @chat and keep @chat_with_docs the same

andy-symonds commented 1 month ago

Could we add our new route names to the tool tip? @lmwilkigov how does this work for you?

Screenshot 2024-07-16 at 18 51 36
andy-symonds commented 1 month ago

@andy-symonds Had a chat with Charlotte and demoed this branch. We think we should rename @chat_no_docs to @chat and keep @chat_with_docs the same

@lmwilkigov done.