Periodically getting Rejected execution on task queue - storage_query error which means DB query is overloaded.
The reason seems to be frequent DataColumnSidecarDB.streamColumnIdentifiers() invocations which is caused by
Wrong implementation of triggering DasCustodySync.fillUp(): the method could be called about 30 times in a row which is probably caused by the async nature of custody.retrieveMissingColumns()
Suboptimal implementation of DataColumnSidecarCustodyImpl.retrieveMissingColumns which returns minimum 200 entries instead of streaming them in a lazy fashion
Periodically getting
Rejected execution on task queue - storage_queryerror which means DB query is overloaded. The reason seems to be frequentDataColumnSidecarDB.streamColumnIdentifiers()invocations which is caused byDasCustodySync.fillUp(): the method could be called about 30 times in a row which is probably caused by the async nature ofcustody.retrieveMissingColumns()DataColumnSidecarCustodyImpl.retrieveMissingColumnswhich returns minimum 200 entries instead of streaming them in a lazy fashion