search

NCEAS / metacat

Data repository software that helps researchers preserve, share, and discover data
https://knb.ecoinformatics.org/software/metacat
GNU General Public License v2.0
26 stars 12 forks source link

performance enhancement through index reduction #699

Closed mbjones closed 5 years ago

mbjones commented 6 years ago

Author Name: Matt Jones (Matt Jones) Original Redmine Issue: 4551, https://projects.ecoinformatics.org/ecoinfo/issues/4551 Original Date: 2009-11-13 Original Assignee: Jing Tao

PISCO configures their metacat server to index only absolute paths in their metadata documents (rather than relative paths), which decreases the size of their index tables by about 3/4 and results in significant query speed improvements.

This requires also refactoring clients (skins, Morpho, Kepler, ...) to only pose queries with absolute paths, as the queries would otherwise not take advantage of the index.

Investigate whether there are advantages to this approach for the KNB metacat installations -- I suspect it would, as the xml_index table would decrease in size massively. This may be important as we work on building the size of our collection through DataONE.

mbjones commented 6 years ago

Original Redmine Comment Author Name: Michael Daigle (Michael Daigle) Original Date: 2009-11-18T20:28:45Z

Also will look at having the ability to keep relative searches by searching on absolute paths.

mbjones commented 6 years ago

Original Redmine Comment Author Name: Redmine Admin (Redmine Admin) Original Date: 2013-03-27T21:27:15Z

Original Bugzilla ID was 4551

mbjones commented 5 years ago

Closing, no longer relevant.