search

jupyter-widgets / ipydatagrid

Fast Datagrid widget for the Jupyter Notebook and JupyterLab
BSD 3-Clause "New" or "Revised" License
582 stars 52 forks source link

Large dataframe tabulation - slow initialisation/visualisation #204

Closed bytesemantics closed 3 years ago

bytesemantics commented 3 years ago

Hi

I have a use case where I want to be able to display large dataframes in an interactive table. My definition of 'large' is a frame of > 200k rows; 50 columns.

I have tried other table widgets (qgrid, ipyaggrid) - both struggle to render this dataframe size. ipyaggrid in particular takes an incredibly long time to render the table.

I was hoping for better performance from ipydatagrid -> unfortunately performance appears very similar. Other than trying perspective-python (which I can't currently build :( ), are there any suggestions for improving performance?

gaborbernat commented 3 years ago

Hello, can you please post a reproducible example of this? Thanks!

ibdafna commented 3 years ago

@bytesemantics I'd be keen to see a reproducible example as well! We wrote ipydatagrid with performance in mind. In fact, in this example we render million cells to emphasize performance.

gaborbernat commented 3 years ago

I'll close this, for now, if we ever get a reproducible example of this I'm happy to reopen.

ankostis commented 1 year ago

See also #286