Move Blazegraph to GeoSPARQL enabled image

swiss-art-research-net / bso-data-pipeline

This contains the pipeline for converting BSO input data into CIDOC/RDF

3 stars 0 forks source link

Move Blazegraph to GeoSPARQL enabled image #45

Open fkraeutli opened 1 year ago

fkraeutli commented 1 year ago

Blazegraph needs to be changed to image with GeoSparql enabled (swissartresearx/researchspace-blazegraph2.2.0-20160908-geo-support). Afterwards data needs to be re-ingested, including manually created data that is backed up at https://github.com/swiss-art-research-net/bso-graph-backup.

We need to do a test run and an analysis to make sure that the data is the same before and after.

fkraeutli commented 1 year ago

Ingest has been successfully tested. Next step, recreate bso-staging setup and ingest data.

fkraeutli commented 1 year ago

[x] 1. Remove current Blazegraph instances inclusive volumes
[x] 2. Initialise setup
[x] 3. Check if GeoSPARQL is enabled
[x] 4. (if not, change image and recreate)
[x] 5. Delete checksums for ingest tasks and update-image-region task
[x] 6. Run pipeline
[x] 7. Ingest sMapshot data
[x] 8. Ingest backups
[ ] 9. Verify

fkraeutli commented 1 year ago

Notes:

Platform doesn't start due to presence(?) of LDP container
- action: enter container and delete all .trig files under /runtime-data/ldp/assets, restart
Platform doesn't find secondary repo
- action: disconnect and reconnect secondary blazegraph to docker network (make sure it is the correct network, e.g. 'internal' instead of 'default')
Smapshot ingest executed from local instance by pointing endpoint to installation
For testing backup ingest, changed network to staging (change back after ingest)