search

trelliscope / trelliscopejs-lib

JavaScript viewer for Trelliscope displays
BSD 3-Clause "New" or "Revised" License
29 stars 7 forks source link

Test very large display #780

Closed hafen closed 11 months ago

hafen commented 1 year ago

I added a new example that provides a very large display (1.1 million photos from the Mars rovers). The metaData.jsonp file is >250MB. It's here on GitHub: https://github.com/hafen/trelliscope-examples3/tree/main/mars

I gzipped metaData.jsonp so that it would be easier to commit so you probably need to decompress that before testing.

This provides a good example to test large displays. It takes a long time to load the metadata. On Chrome it works fine but on Safari I get this:

image

It might be nice to add a loading spinner. I'm also wondering if in cases like this I should provide a subset of the metadata for the first 10-20 panels so that we can at least show something while the rest is loading. Any thoughts?

hafen commented 1 year ago

Another possibility for these very large displays is for me to split metaData up into chunks - maybe 50-100k rows per chunk, and we load them asynchronously and use crossfilter.add to update the data as they are loaded. Thoughts?

Incin commented 1 year ago

hmmm i think the ideal solution would be to load it asynchronously especially to lay the foundation in the event a backend is ever implemented. i think this will be good to bring up tomorrow in our meeting too.

Incin commented 11 months ago

this is no longer an issue when we looked into the jsonp to js file and speeding up load times