launchflow / buildflow

BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
https://docs.launchflow.com/buildflow
Apache License 2.0
193 stars 7 forks source link

add more options for autoscaling collectors and endpoints #299

Closed boetro closed 11 months ago

boetro commented 11 months ago

Couple other small change as well:

codecov[bot] commented 11 months ago

Codecov Report

Attention: 11 lines in your changes are missing coverage. Please review.

Comparison is base (495d87d) 77.72% compared to head (5eaf670) 77.64%. Report is 1 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #299 +/- ## ========================================== - Coverage 77.72% 77.64% -0.08% ========================================== Files 160 160 Lines 7047 7060 +13 ========================================== + Hits 5477 5482 +5 - Misses 1570 1578 +8 ``` | [Files](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | Coverage Δ | | |---|---|---| | [buildflow/\_\_init\_\_.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L19faW5pdF9fLnB5) | `100.00% <100.00%> (ø)` | | | [buildflow/core/app/collector.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL2NvbGxlY3Rvci5weQ==) | `94.73% <ø> (ø)` | | | [buildflow/core/app/flow\_state.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL2Zsb3dfc3RhdGUucHk=) | `88.63% <100.00%> (+0.13%)` | :arrow_up: | | [buildflow/core/app/runtime/actors/runtime\_test.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3J1bnRpbWVfdGVzdC5weQ==) | `94.96% <ø> (ø)` | | | [buildflow/core/app/service.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3NlcnZpY2UucHk=) | `93.93% <100.00%> (+0.18%)` | :arrow_up: | | [buildflow/core/options/runtime\_options.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvb3B0aW9ucy9ydW50aW1lX29wdGlvbnMucHk=) | `97.36% <100.00%> (+0.07%)` | :arrow_up: | | [buildflow/core/app/flow.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL2Zsb3cucHk=) | `76.79% <75.00%> (+0.04%)` | :arrow_up: | | [...runtime/actors/collector\_pattern/collector\_pool.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL2NvbGxlY3Rvcl9wYXR0ZXJuL2NvbGxlY3Rvcl9wb29sLnB5) | `50.94% <0.00%> (-2.00%)` | :arrow_down: | | [...tors/collector\_pattern/receive\_process\_push\_ack.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL2NvbGxlY3Rvcl9wYXR0ZXJuL3JlY2VpdmVfcHJvY2Vzc19wdXNoX2Fjay5weQ==) | `34.83% <0.00%> (-1.54%)` | :arrow_down: | | [...p/runtime/actors/endpoint\_pattern/endpoint\_pool.py](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL2VuZHBvaW50X3BhdHRlcm4vZW5kcG9pbnRfcG9vbC5weQ==) | `50.00% <0.00%> (-1.93%)` | :arrow_down: | | ... and [2 more](https://app.codecov.io/gh/launchflow/buildflow/pull/299?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.