fbdesignpro / sweetviz

Visualize and compare datasets, target values and associations, with one line of code.
MIT License
2.91k stars 274 forks source link

sweetviz and large datasets #102

Closed ronmorg closed 11 months ago

ronmorg commented 2 years ago

i seem to get an error when working or analyzing dataset that are greater than 890000 rows is this a bug or is there a limit on the record size. I basically use pyodbc to get data from a table and pass it as a dataframe. get a pandas error. i have 30 gig on memeory on pc pc

fbdesignpro commented 2 years ago

Hello @ronmorg! I know it's been a while, but I was wondering if you had more details on this error. There is definitely no upper limit and I have seen Sweetviz being used with much larger data sets. It might be a memory or some other related issue. I would like to look into the issue but if I don't hear back I will close the issue.

fbdesignpro commented 11 months ago

Closing due to inactivity.