View / Export chats from Application Insights

Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

https://azure.microsoft.com/products/search

MIT License

5.6k stars 3.75k forks source link

View / Export chats from Application Insights #847

Open florianlanger opened 8 months ago

florianlanger commented 8 months ago

[ ] bug report -> please search issues before submitting
[ ] feature request
[x] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

How can I view past chats using Application Insight ? I have it enabled and can access it on Azure > Application Insights > Investigate > Transaction search but can't seem to find the actual messages anywhere. Also it would be amazing if there was an easy way to export all past chat histories with time stamp and which user called as a csv, json, or similar. Thanks for any help!

tonybaloney commented 8 months ago

The Application Insights configuration in the demo app is for tracing errors and performance of the backend service and dependant APIs. It doesn't capture the chat request messages mainly because that would include things like API keys and other secure data. Have a look in the Performance tab and find a POST to /chat then use the Drill into samples button to see all the related data.

tonybaloney commented 8 months ago

I think you could achieve this result by setting a Diagnostic Log using this guide https://learn.microsoft.com/en-us/azure/ai-services/diagnostic-logging

github-actions[bot] commented 5 months ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.