search

opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
https://opea.dev
Apache License 2.0
256 stars 177 forks source link

Allow Users to view the retrieved excerpts in ChatQnA #586

Closed yogeshmpandey closed 1 day ago

yogeshmpandey commented 2 months ago

Currently, in the ChatQnA Demo application, users cannot view the excerpts retrieved from the knowledge base and used by the Language Model (LLM) to generate the answers. It would be beneficial for users to see these excerpts, as it would provide transparency into the reasoning process of the LLM and help users understand the context and sources of the generated answers.

lkk12014402 commented 2 months ago

hi, retrieval and reranking results are not included in the ChatQnA final response now.

I also think it would be beneficial for users to see retrieval/reranking excerpts. And we will consider this as a new feature.

lkk12014402 commented 1 day ago

we can request retriever microservice to get the retrieval knowledge, refer to https://github.com/opea-project/GenAIExamples/tree/main/ChatQnA/docker_compose/intel/hpu/gaudi#validate-microservices-and-megaservice

image

xiguiw commented 1 day ago

@lkk12014402 @kevinintel @yogeshmpandey Is the retriever/reranking micro-service enough for this request?

Some questions:

  1. How to convince users the retriever/reranking results are the same as those input to LLM in ChatQnA Example?
  2. For the reranking output, retriever output needs to be connected to reranking input. It is missed here.