launchflow / buildflow

BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
https://docs.launchflow.com/buildflow
Apache License 2.0
193 stars 7 forks source link

Expose ray gpu & memory options #267

Open JoshTanke opened 1 year ago

JoshTanke commented 1 year ago

note: This temp PR does not include the needed changes to the autoscaler, so memory and gpu requirements will not be factored into any of the autoscale events.

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 16.66% and project coverage change: -0.19% :warning:

Comparison is base (4f5b99e) 76.70% compared to head (d0c1d75) 76.51%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #267 +/- ## ========================================== - Coverage 76.70% 76.51% -0.19% ========================================== Files 160 160 Lines 6022 6039 +17 ========================================== + Hits 4619 4621 +2 - Misses 1403 1418 +15 ``` | [Files Changed](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | Coverage Δ | | |---|---|---| | [buildflow/core/app/flow.py](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL2Zsb3cucHk=) | `59.42% <ø> (ø)` | | | [...tors/collector\_pattern/receive\_process\_push\_ack.py](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL2NvbGxlY3Rvcl9wYXR0ZXJuL3JlY2VpdmVfcHJvY2Vzc19wdXNoX2Fjay5weQ==) | `27.77% <0.00%> (-1.35%)` | :arrow_down: | | [...actors/endpoint\_pattern/receive\_process\_respond.py](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL2VuZHBvaW50X3BhdHRlcm4vcmVjZWl2ZV9wcm9jZXNzX3Jlc3BvbmQucHk=) | `30.30% <0.00%> (-1.62%)` | :arrow_down: | | [...p/runtime/actors/pipeline\_pattern/pipeline\_pool.py](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3BpcGVsaW5lX3BhdHRlcm4vcGlwZWxpbmVfcG9vbC5weQ==) | `24.39% <0.00%> (-1.59%)` | :arrow_down: | | [buildflow/core/options/runtime\_options.py](https://app.codecov.io/gh/launchflow/buildflow/pull/267?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvb3B0aW9ucy9ydW50aW1lX29wdGlvbnMucHk=) | `97.50% <100.00%> (+0.13%)` | :arrow_up: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.