microsoft / lida

Automatic Generation of Visualizations and Infographics using Large Language Models
https://microsoft.github.io/lida/
MIT License
2.66k stars 282 forks source link

Large dataset summary exceeds context size? #16

Closed 0xaaiden closed 1 year ago

0xaaiden commented 1 year ago

Uploaded a fairly large datasets (> 40 columns) and seems like the summary and response size exceeded the maximum context size.

Would it be possible to compress the summary size or let the users choose which columns are relevant to generate charts?

image

victordibia commented 1 year ago

Yes! This is a great idea, and important too! Will start work on a fix and post updates here!