ePADD / epadd

ePADD is a software package developed by Stanford University's Special Collections & University Archives that supports archival processes around the appraisal, ingest, processing, discovery, and delivery of email archives.
https://www.epaddproject.org
112 stars 24 forks source link

Collection loading time for 2 million messages #396

Closed chinuhub closed 1 year ago

chinuhub commented 3 years ago

An archive containing 2 million messages takes around 15 minutes to load (show browse top screen). After creating persistent summary data we were able to reduce the subsequent load time to 5 minutes for 2 million messages. However, there is still an opportunity to reduce this time further by making the entity summary data persistent so that this summary data is not recomputed at every load of an archive.