TAMULib / scholars-discovery

MIT License
1 stars 1 forks source link

Add caching for triplestore harvest #345

Closed ghost closed 1 year ago

ghost commented 1 year ago

Query and cache top level model properties for all individuals before indexing. Lookup field by subject while populating the index document.

ghost commented 1 year ago

This is a tradeoff of memory for time. Unfortunately, with early testing the Jena TDB SparQL responses are too slow and the granular SparQL is still faster and more parallelizable.