Request: Visualise datasets longer than context length

microsoft / lida

Automatic Generation of Visualizations and Infographics using Large Language Models

https://microsoft.github.io/lida/

MIT License

2.71k stars 290 forks source link

Request: Visualise datasets longer than context length #62

Open naethanjac opened 11 months ago

naethanjac commented 11 months ago

Currently the data needs to 'loaded' into the context window as a pandas dataframe. Is there any scope for extending this project to deal with large scale tabular databases that use pyspark dataframes, sql, etc