idn-au / catalogue-data

Creative Commons Attribution 4.0 International
0 stars 1 forks source link

Troubleshoot performance issues with Fuseki #54

Closed lalewis1 closed 3 months ago

lalewis1 commented 3 months ago

NCI Fuseki is using lots of disk space and taking ~ 20 min to start up. there may be some configuration options that are degrading performance.

Perhaps the uid field on the text index should be set? so that dropped triples can be removed from the index.

lalewis1 commented 3 months ago

cannot replicate performance issues locally.

same setup takes approx 2 mins to startup.

lalewis1 commented 3 months ago

Currently it looks like it might be to do with the file system at NCI. they have it mounted to a distributed file system. disk r/w 80Mb/s

investigation ongoing

lalewis1 commented 3 months ago

resolved for now. managed to improve performance to an acceptable level by compacting the database.