search

launchflow / buildflow

BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
https://docs.launchflow.com/buildflow
Apache License 2.0
193 stars 7 forks source link

fix: update autoscaler to use cpu percentage for downscaling #215

Closed boetro closed 1 year ago

boetro commented 1 year ago

couple other small fixes in here:

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 78.71% and project coverage change: +2.30 :tada:

Comparison is base (7a1ced5) 71.87% compared to head (462fc02) 74.18%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #215 +/- ## ========================================== + Coverage 71.87% 74.18% +2.30% ========================================== Files 75 76 +1 Lines 2610 2855 +245 ========================================== + Hits 1876 2118 +242 - Misses 734 737 +3 ``` | [Impacted Files](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | Coverage Δ | | |---|---|---| | [...ldflow/core/io/gcp/strategies/pubsub\_strategies.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL3N0cmF0ZWdpZXMvcHVic3ViX3N0cmF0ZWdpZXMucHk=) | `51.32% <0.00%> (ø)` | | | [buildflow/core/app/runtime/actors/runtime.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3J1bnRpbWUucHk=) | `30.40% <17.39%> (-1.14%)` | :arrow_down: | | [...ntime/actors/pipeline\_pattern/pull\_process\_push.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3BpcGVsaW5lX3BhdHRlcm4vcHVsbF9wcm9jZXNzX3B1c2gucHk=) | `21.83% <18.18%> (-0.31%)` | :arrow_down: | | [...p/runtime/actors/pipeline\_pattern/pipeline\_pool.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3BpcGVsaW5lX3BhdHRlcm4vcGlwZWxpbmVfcG9vbC5weQ==) | `42.46% <28.57%> (-1.37%)` | :arrow_down: | | [buildflow/core/app/runtime/actors/process\_pool.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3Byb2Nlc3NfcG9vbC5weQ==) | `40.22% <50.00%> (+0.66%)` | :arrow_up: | | [...dflow/core/io/local/strategies/pulse\_strategies.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vbG9jYWwvc3RyYXRlZ2llcy9wdWxzZV9zdHJhdGVnaWVzLnB5) | `84.61% <66.66%> (+0.61%)` | :arrow_up: | | [buildflow/core/options/runtime\_options.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvb3B0aW9ucy9ydW50aW1lX29wdGlvbnMucHk=) | `97.29% <83.33%> (-2.71%)` | :arrow_down: | | [...ldflow/core/io/local/testing/pulse\_with\_backlog.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vbG9jYWwvdGVzdGluZy9wdWxzZV93aXRoX2JhY2tsb2cucHk=) | `88.23% <88.23%> (ø)` | | | [buildflow/core/app/runtime/autoscaler.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYXV0b3NjYWxlci5weQ==) | `94.52% <92.15%> (+70.03%)` | :arrow_up: | | [buildflow/core/app/runtime/actors/runtime\_test.py](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3J1bnRpbWVfdGVzdC5weQ==) | `94.77% <96.51%> (-1.75%)` | :arrow_down: | | ... and [6 more](https://app.codecov.io/gh/launchflow/buildflow/pull/215?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | | ... and [1 file with indirect coverage changes](https://app.codecov.io/gh/launchflow/buildflow/pull/215/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.