Loading the couchDB page when you have "lots" of failures causes firefox to freeze up

dmwm / WMCore

Core workflow management components for CMS.

Apache License 2.0

45 stars 106 forks source link

Loading the couchDB page when you have "lots" of failures causes firefox to freeze up #1748

Closed DMWMBot closed 11 years ago

DMWMBot commented 13 years ago

When you try loading the CouchDB page for WF's where there are lots of failures, Firefox freezes up and your computer starts sounding like it's going to launch... not very good for the computer.... We need a work around for DataOps:
Sample of a page giving us fits would be the couchDB page for the following WF... I'd try loading it but then I wouldn't be able to file the ticket ;)

cmsdataops_EWK-Summer11_R1-00010_T1_FR_CCIN2P3_MSS_110530_175329

drsm79 commented 13 years ago

metson: Jen, can you be a bit more careful when opening tickets to assign them to the right component? If you're not sure WMcore is a good guess (I think I'll make that default when I get to CERN).

sfoulkes commented 13 years ago

sfoulkes: The workflow summary page is rendered entirely in the client and needs to download JSON from all failed jobs and all of the FWJRs from all failed jobs. This adds up: failed jobs JSON: 20,043,468 failed FWJR JSON: 263,447,451

Downloading 280MB of data isn't good and completely locked up my browser. I'll attempt to trim some of the fat off of this and see where we can make some improvements.

evansde77 commented 13 years ago

evansde: Its possible that there is just too much information being shown on one page. We may want to look at two APIs here:

A basic list of the failures for a summary (N jobs failed with IDs A,B,C...)
A more detailed, paged view that fetches the data in increments

DMWMBot commented 12 years ago

mnorman: Pushing this back by a month to give us some breathing space.