Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
https://azure.microsoft.com/products/search
MIT License
6.39k stars 4.27k forks source link

Integration of Chatgpt- Data Analyst features #1916

Open nits-aidev opened 3 months ago

nits-aidev commented 3 months ago

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [x ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

We can integrate Chatgpt's Data Analyst features with Current upload features , so it would help analyzing any uploaded content or existing content. It can analyze documents, generate reports, create presentations, interpret data, and provide insights.

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful


Thanks! We'll be in touch soon.

pamelafox commented 3 months ago

The Data Analyst feature of ChatGPT is a part of their user-facing product, and not directly exposed in the API, as far as I know. However, there is a Code Interpreter tool in the Assistants API that does some aspects of that. Since this repo doesn't use the assistants API and just uses the OpenAI SDK directly, you could implement a Code Interpreter using, using Azure Container Apps Dynamic Sessions for isolated execution. @anthonychu demonstrated that at Pycon this year: https://github.com/anthonychu/20240528-sessions-csv/blob/main/query-csv.ipynb

He'll also be presenting it in a few weeks as a RAGHack live stream https://reactor.microsoft.com/reactor/events/23340/

I think it would be very cool if we could optionally support devs bringing in a Code Interpreter tool.