search

Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
https://azure.microsoft.com/products/search
MIT License
5.59k stars 3.75k forks source link

Generating Charts #1674

Open mirojs opened 3 weeks ago

mirojs commented 3 weeks ago

Please provide us with the following information:

The new model is good on data analysis. And suggestion on visualizing the results into typical charts?

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [x] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

Lawndemon commented 3 weeks ago

I think you would need to include Dall-e if you want to have the solution return images. I'm planning to experiment with this once I get reranking working better but at this point I don't think it's a quick addition to put it mildly. Maybe it's easier than I'm thinking?

pamelafox commented 3 weeks ago

Another approach would be to use something like matplotlib to generate the charts. The models are pretty good at writing matplotlib code. You'd want to run the matplotlib code in a sandboxed environment through, like the new dynamic sessions on Azure Container Apps. See this example from @anthonychu's Pycon talk: https://github.com/anthonychu/20240528-sessions-csv/blob/main/query-csv.ipynb

anthonychu commented 3 weeks ago

Yep that would work great here if the goal is to upload a CSV and ask it questions. My example doesn’t include a graph example but can add one.

mirojs commented 3 weeks ago

@anthonychu The OpenAI Spring video is quite impressive in terms of CSV visualization. @pamelafox Matplotlib is good. Besides, it there any consideration of including semantic kernel etc. into the repo so that plugins could play a role?

mirojs commented 2 weeks ago

@anthonychu Could the graph example be added in the near future? Would Pandas be more convenient over Metaplotlib? Thanks