HumanSignal / Adala

Adala: Autonomous DAta (Labeling) Agent framework
https://humansignal.github.io/Adala/
Apache License 2.0
979 stars 77 forks source link

fix: DIA-1619: logging and graceful handling for memory leaks #253

Closed matt-bernstein closed 1 week ago

matt-bernstein commented 1 week ago

set https://docs.celeryq.dev/en/v5.4.0/userguide/workers.html#max-memory-per-child-setting so that when a child process hits 1GB, which is about 60% of the total memory limit for the whole worker, it is gracefully restarted after the current task finishes. Plus some cleanup and logging.

codecov-commenter commented 1 week ago

Codecov Report

Attention: Patch coverage is 57.14286% with 6 lines in your changes missing coverage. Please review.

Project coverage is 66.32%. Comparing base (0ac4d2e) to head (0f14e14). Report is 5 commits behind head on master.

Files with missing lines Patch % Lines
server/tasks/stream_inference.py 53.84% 6 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #253 +/- ## ========================================== + Coverage 66.29% 66.32% +0.03% ========================================== Files 47 47 Lines 2436 2459 +23 ========================================== + Hits 1615 1631 +16 - Misses 821 828 +7 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


🚨 Try these New Features: