Improve Ingestion Performance

TIBHannover / ols4

The upcoming next version of the Ontology Lookup Service (OLS)

http://www.ebi.ac.uk/ols4/

Apache License 2.0

2 stars 0 forks source link

Improve Ingestion Performance #14

Open giraygi opened 4 weeks ago

giraygi commented 4 weeks ago

Is your feature request related to a problem? Please describe. The import tool has been replaced by csv2neo module. The queries in the module need to be optimized.

Describe the solution you'd like Use of transactions will be optional. Computationally demanding components will be removed from queries.

Describe alternatives you've considered Batch insertion methods with UNWIND will be investigated.

giraygi commented 1 week ago

Ingestion pipeline is problematic on the backend calls: http://localhost:8080/api/v2/ontologies/edam/classes/http%253A%252F%252Fedamontology.org%252Fdata_0006/hierarchicalChildren?size=1000&lang=en&includeObsoleteEntities=undefined