Open saraadams opened 1 year ago
If latency is high, then having many parallel check cache hit actions can help speed up getting remote cache hits (as the jobs are idle due to high latency).
An estimated latency might be extracted by looking for the shortest check cache hit
entry.
Increasing --jobs to above your machine's # of cores could help.
action processing
disk_cache
or remote_cache
)
remote action cache check
remote output download
, but not any events indicating remote execution (e.g. of category remote action execution
)
Problem
Surface the action cache hit rate, in particular if remote caching is used.
Suggested solution
The following events may help detect these:
check cache hit
(categoryremote action cache check
) within eventActionContinuation.execute
(categorygeneral information
), thereafter executionupload missing inputs
(categoryRemote execution upload time
) followed byexecute remotely
(categoryremote action execution
)check cache hit
within eventActionContinuation.execute
, no execution thereafterDataProvider
to provide rate and/or absolute numbers (cache checks, successful cache checks)SuggestionProvider
to suggest strategies to increase the cache hit rate, e.g. --incompatible_strict_action_env