HumanSignal / Adala

Adala: Autonomous DAta (Labeling) Agent framework
https://humansignal.github.io/Adala/
Apache License 2.0
911 stars 72 forks source link

change consumer timeouts to 1.5sec and task timeout to 6hrs #138

Closed matt-bernstein closed 2 months ago

matt-bernstein commented 2 months ago

consumer timeouts - reduce time to first record w/ tradeoff of increased change that a long-running record is dropped

(longest running record -> exponential retry backoff w/ max of 1sec)

task timeout - reduce potential number of zombie jobs w/ tradeoff of increased chance of canceling a long-running job

(longest projected job -> 10k records has worst case 10 mins from load test, so 100k records would be <2hrs)

robot-ci-heartex commented 2 months ago

Commit https://github.com/HumanSignal/infra/commit/5c0e1611332053874794d590e3ba6eebe7168d51 is created.

codecov-commenter commented 2 months ago

Codecov Report

Attention: Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.

Project coverage is 43.76%. Comparing base (fcd7eaf) to head (b614c57).

Files Patch % Lines
server/utils.py 0.00% 3 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #138 +/- ## ======================================= Coverage 43.76% 43.76% ======================================= Files 40 40 Lines 1812 1812 ======================================= Hits 793 793 Misses 1019 1019 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

robot-ci-heartex commented 2 months ago

Commit https://github.com/HumanSignal/infra/commit/5c07a02b3e62d7aa7b7d650f1092e58c139eae29 is created.