cache files in space to speed up rendering - Githubissues

clowder-framework / clowder

A data management system that allows users to share, annotate, organize and analyze large collections of datasets. It provides support for extensible metadata annotation using JSON-LD and a distribute analytics event bus for automatic curation of uploaded data.

https://clowderframework.org/

University of Illinois/NCSA Open Source License

37 stars 17 forks source link

cache files in space to speed up rendering #299

Closed robkooper closed 2 years ago

robkooper commented 3 years ago

for spaces with large number of datasets this would result in compute times of minutes. Now data is cached and will speed up processing.

Description

Review Time Estimate

[ ] Immediately
[ ] Within one week
[X] When possible

Types of changes

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My change requires a change to the documentation.
[X] I have updated the CHANGELOG.md.
[ ] I have signed the CLA
[ ] I have updated the documentation accordingly.
[ ] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

robkooper commented 2 years ago

@lmarini fixed, this also resulted in the byte count being wrong for a space.