Closed hgeorgsch closed 2 years ago
Repeatable traits is also the concern in #95 , which should probably be resolved first.
When other critical issues are solved, we need to remove debug tracing and test performance. This is a critical step, after which we can assess the need for further improvement.
Startup is now down to 100 CPU-seconds on shannon, compared ~113 before the refactoring. Further improvements may be possible when we review the code. #100 CPU load is under 200%, so it is possible that further parallellisation may work too. The put script takes ~170 CPU second on the server.
New tests show a r/t improvement from 1'06s to 40s on the put script. No improvement on the other scripts, and no improvement on CPU time, but the latter is difficult to measure.
THere does not seem to be more to do here. Further speedups must be found elsewhere.
This will also help for #94 . Can we speed up advancement calculation, possibly by working directly on RDF graphs. There are several obstacles.