Feature: Add Virtuso, Allegrograph and Graphdb integration to OLD

ontoportal-lirmm / ontologies_linked_data

Models and serializers for ontologies and related artifacts backed by 4store

Other

0 stars 6 forks source link

Prerequisites

https://github.com/ontoportal-lirmm/goo/pull/48

Context

This PR makes the ths following triple stores: 4store (fs), GraphDb (gb), Virtuoso (vo), and AllegroGraph (ag), work with ontologies_linked_data and add their test workflows.

Benchmarks before test optimizations

Store	Time with slices=20	Time with slices=100	Time with slices=500 (production)
4store	24,88min	21,6min	24,31min 🏅
GraphDb	24,3min	19,95min 🏅	24,9 min
Virtuoso	20,61 🏅	20,85min	34,43min
AllegroGraph	27,96min	26,21min	26,5min

Summary

Store/Slices	Time
GraphDb / 100 slices	19,95min 🏅
Virtuoso / 20 slices	20,61min
Virtuoso / 100 slices	20,85min
4store / 100 slices	21,6min
GraphDb / 20 slices	24,3min
4store / 500 slices	24,31min
4store / 20 slices	24,88min
GraphDb / 500 slices	24,9min
AllegroGraph / 100 slices	26,21min
AllegroGraph / 500 slices	26,5min
AllegroGraph / 20 slices	27,96min
Virtuoso / 500 slices	34,43min

Notes

Virtuoso is really slow with slices equal to 500, we see this time gap with aggregate queries.
The best solution would be Virtuoso or GraphDb with 100 slices.

Benchmarks after test optimizations

Store	Time with slices=20	Time with slices=100	Time with slices=500 (production)
4store	10,98min	9,6min	11,3min
GraphDb	8,48min	8,7min	8,55min 🏅
Virtuoso	9,63min	7,95min 🏅	9,36min
AllegroGraph	8,28min 🏅	8,03min	11,7min

Summary

Store/Slices	Time
Virtuoso / 100 slices	7,95min 🏅
AllegroGraph / 100 slices	8,03min
AllegroGraph / 20 slices	8,28min
GraphDb / 20 slices	8,48min
GraphDb / 500 slices	8,55min
GraphDb / 100 slices	8,7min
Virtuoso / 500 slices	9,36min
4store / 100 slices	9,6min
Virtuoso / 20 slices	9,63min
4store / 20 slices	10,98min
4store / 500 slices	11,3min
AllegroGraph / 500 slices	11,7min

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (451ae22) 79.92% compared to head (ea74018) 79.94%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## development #106 +/- ## =============================================== + Coverage 79.92% 79.94% +0.01% =============================================== Files 84 84 Lines 6132 6132 =============================================== + Hits 4901 4902 +1 + Misses 1231 1230 -1 ``` | [Flag](https://app.codecov.io/gh/ontoportal-lirmm/ontologies_linked_data/pull/106/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ontoportal-lirmm) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/ontoportal-lirmm/ontologies_linked_data/pull/106/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ontoportal-lirmm) | `79.94% <100.00%> (+0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ontoportal-lirmm#carryforward-flags-in-the-pull-request-comment) to find out more.

ontoportal-lirmm / ontologies_linked_data