Data tables performance improvements

ideaconsult / Toxtree.js

http://ideaconsult.github.io/Toxtree.js/

2 stars 3 forks source link

Data tables performance improvements #179

Open vedina opened 8 years ago

vedina commented 8 years ago

The display of search results for chemical structures needs to be optimised in order to become more responsive. For a large set of results currently the screen stays empty and the data table appears only after the entire result is filled in. I can see two ways of improvements:

fill in the datatable as the results come in (this was done for older versions predating jToxKit )
introduce server side support for datatables, filling in only the first page initially and perform queries on subsequent pages as the users browses the data.

@thejonan @gonzomir what are your preferences and thoughts? Can we discuss it this week (skype)?

thejonan commented 8 years ago

I think, we've discussed that long ago with the conclusion that we need server-side paging support. Actually, I thought we already have it.

Option one looks tempting, because it seems like "abstracting the visualisation problem, to the visualisation part, i.e. UI", but in the end, it'll overwhelm the browser with too much data.

I'm fine for Skype discussion.

vedina commented 8 years ago

Yes, there is paging support.

thejonan commented 8 years ago

So, I'm missing some details then. Do we know what exactly is the slowest part? Could it be the server preparing the query? I guess we can do some profiling and checking time consumption of each stage and request - time for request, time before data starts arriving, download time, etc.

vedina commented 8 years ago

Yes, we shall start with profiling. My guess at this moment is the bottleneck it is the amount of data transferred, as I have seen the uncomfortable delay on saturated connections, and not on fast ones. But it could be combination of factors, including server preparing the query.