Create modular component to verify quality of response

Azure-Samples / azure-search-openai-javascript

A TypeScript sample app for the Retrieval Augmented Generation pattern running on Azure, using Azure AI Search for retrieval and Azure OpenAI and LangChain large language models (LLMs) to power ChatGPT-style and Q&A experiences.

MIT License

252 stars 130 forks source link

Create modular component to verify quality of response #173

Closed dfberry closed 8 months ago

dfberry commented 10 months ago

1) Create a FE UI such as thumbs up/thumbs down to provide feedback on the quality of the response. 2) Create a BE to capture feedback.

https://github.com/microsoft/sample-app-aoai-chatGPT/pull/396

@PamelaFox please edit/update with any more requirements.

pamelafox commented 10 months ago

Here's the Python issue from developers requesting it: https://github.com/Azure-Samples/azure-search-openai-demo/issues/489 You might get more ideas there. Also from checking to see how GitHub Copilot and ChatGPT do it.

I wonder whether it should include an admin-auth'd frontend for reviewing the feedback, and/or dashboards showing its rate over time, alerts for low numbers, etc.

github-actions[bot] commented 8 months ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.

github-actions[bot] commented 8 months ago

This issue was closed because it has been stalled for 7 days with no activity.