At one point the Danish Web Archive entered a state where 5 out of 17 shards used 1 full CPU each and did not return large facet calls (6 fields), but still processed calls for a single facet (url). The newly introduced cache system is the culprit and the whole priority-background-cleaning code should be triple-checked.
At one point the Danish Web Archive entered a state where 5 out of 17 shards used 1 full CPU each and did not return large facet calls (6 fields), but still processed calls for a single facet (url). The newly introduced cache system is the culprit and the whole priority-background-cleaning code should be triple-checked.
This bug has not been reproduced in test.