gchq / Gaffer

A large-scale entity and relation database supporting aggregation of properties
Apache License 2.0
1.75k stars 353 forks source link

Gh-3096: JobTracker Performance Improvement #3148

Closed tb06904 closed 4 months ago

tb06904 commented 5 months ago

Various improvements to the Job Tracker (and subsequently the cache) to hopefully address some of the performance issues. There may be other areas but the main changes and rational behind them are:

Once performance tests are in place they should verify if improvements have made substantial difference.

Related issue

codecov[bot] commented 5 months ago

Codecov Report

Attention: Patch coverage is 66.66667% with 48 lines in your changes are missing coverage. Please review.

Project coverage is 66.34%. Comparing base (7f8832f) to head (cecaf66).

Files Patch % Lines
...java/uk/gov/gchq/gaffer/jobtracker/JobTracker.java 26.08% 17 Missing :warning:
...va/uk/gov/gchq/gaffer/cache/impl/HashMapCache.java 20.00% 7 Missing and 1 partial :warning:
...ation/handler/named/cache/NamedOperationCache.java 65.21% 8 Missing :warning:
...java/uk/gov/gchq/gaffer/store/StoreProperties.java 0.00% 4 Missing :warning:
.../src/main/java/uk/gov/gchq/gaffer/cache/Cache.java 57.14% 3 Missing :warning:
.../operation/handler/named/cache/NamedViewCache.java 76.92% 0 Missing and 3 partials :warning:
...gchq/gaffer/graph/hook/NamedOperationResolver.java 90.00% 2 Missing :warning:
...src/main/java/uk/gov/gchq/gaffer/cache/ICache.java 66.66% 1 Missing :warning:
.../src/main/java/uk/gov/gchq/gaffer/store/Store.java 90.00% 0 Missing and 1 partial :warning:
...q/gaffer/federatedstore/FederatedGraphStorage.java 94.73% 0 Missing and 1 partial :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3148 +/- ## ============================================= + Coverage 66.30% 66.34% +0.04% - Complexity 2543 2545 +2 ============================================= Files 909 907 -2 Lines 29026 28975 -51 Branches 3225 3216 -9 ============================================= - Hits 19246 19224 -22 + Misses 8343 8319 -24 + Partials 1437 1432 -5 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.