search

Sinaptik-AI / pandas-ai

Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
https://pandas-ai.com
Other
11.85k stars 1.1k forks source link

Incorporate DataSketches for simple operations? #23

Closed HarrySng closed 1 month ago

HarrySng commented 1 year ago

There's a package called approximatelabs/sketch that implements something similar but it relies on Apache DataSketches to implement certain summary operations. Is there a possible integration opportunity here? There are a number of simple operations that can be executed without the need for code generation from an LLM.

gventuri commented 1 year ago

@HarrySng reopening as this is indeed a very interesting idea. We should just figure out how to have it implemented, but I love the idea.