flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.67k stars 223 forks source link

Local backing #1400

Closed reyna-abhyankar closed 3 months ago

reyna-abhyankar commented 4 months ago

Description of changes:

Implement LocalTrainingBacking and TaskRegistry:

Linked Issues:

Issues closed by this PR:


This change is Reviewable

codecov[bot] commented 4 months ago

Codecov Report

Attention: Patch coverage is 0.24272% with 822 lines in your changes missing coverage. Please review.

Project coverage is 25.60%. Comparing base (35b1741) to head (d0e37b1).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## repo-refactor #1400 +/- ## ================================================== - Coverage 38.10% 25.60% -12.51% ================================================== Files 167 228 +61 Lines 5026 7484 +2458 Branches 246 294 +48 ================================================== + Hits 1915 1916 +1 - Misses 3111 5568 +2457 ``` | [Flag](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | `25.60% <0.24%> (-12.51%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | Coverage Δ | | |---|---|---| | [lib/kernels/include/kernels/allocation.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fkernels%2Finclude%2Fkernels%2Fallocation.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2tlcm5lbHMvaW5jbHVkZS9rZXJuZWxzL2FsbG9jYXRpb24uaA==) | `0.00% <ø> (ø)` | | | [lib/kernels/include/kernels/array\_shape.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fkernels%2Finclude%2Fkernels%2Farray_shape.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2tlcm5lbHMvaW5jbHVkZS9rZXJuZWxzL2FycmF5X3NoYXBlLmg=) | `0.00% <ø> (ø)` | | | [.../local-execution/include/local-execution/arg\_ref.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Flocal-execution%2Finclude%2Flocal-execution%2Farg_ref.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2xvY2FsLWV4ZWN1dGlvbi9pbmNsdWRlL2xvY2FsLWV4ZWN1dGlvbi9hcmdfcmVmLmg=) | `0.00% <ø> (ø)` | | | [...l-execution/include/local-execution/concrete\_arg.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Flocal-execution%2Finclude%2Flocal-execution%2Fconcrete_arg.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2xvY2FsLWV4ZWN1dGlvbi9pbmNsdWRlL2xvY2FsLWV4ZWN1dGlvbi9jb25jcmV0ZV9hcmcuaA==) | `0.00% <ø> (ø)` | | | [...ution/include/local-execution/op\_task\_invocation.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Flocal-execution%2Finclude%2Flocal-execution%2Fop_task_invocation.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2xvY2FsLWV4ZWN1dGlvbi9pbmNsdWRlL2xvY2FsLWV4ZWN1dGlvbi9vcF90YXNrX2ludm9jYXRpb24uaA==) | `0.00% <ø> (ø)` | | | [...cution/include/local-execution/op\_task\_signature.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Flocal-execution%2Finclude%2Flocal-execution%2Fop_task_signature.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL2xvY2FsLWV4ZWN1dGlvbi9pbmNsdWRlL2xvY2FsLWV4ZWN1dGlvbi9vcF90YXNrX3NpZ25hdHVyZS5o) | `0.00% <ø> (ø)` | | | [lib/op-attrs/include/op-attrs/get\_output\_shapes.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fop-attrs%2Finclude%2Fop-attrs%2Fget_output_shapes.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL29wLWF0dHJzL2luY2x1ZGUvb3AtYXR0cnMvZ2V0X291dHB1dF9zaGFwZXMuaA==) | `0.00% <ø> (ø)` | | | [lib/op-attrs/src/op-attrs/get\_op\_type.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fop-attrs%2Fsrc%2Fop-attrs%2Fget_op_type.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL29wLWF0dHJzL3NyYy9vcC1hdHRycy9nZXRfb3BfdHlwZS5jYw==) | `3.33% <ø> (+0.10%)` | :arrow_up: | | [lib/op-attrs/src/op-attrs/ops/element\_unary.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fop-attrs%2Fsrc%2Fop-attrs%2Fops%2Felement_unary.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL29wLWF0dHJzL3NyYy9vcC1hdHRycy9vcHMvZWxlbWVudF91bmFyeS5jYw==) | `100.00% <ø> (+50.00%)` | :arrow_up: | | [lib/op-attrs/test/src/test\_element\_unary.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree&filepath=lib%2Fop-attrs%2Ftest%2Fsrc%2Ftest_element_unary.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL29wLWF0dHJzL3Rlc3Qvc3JjL3Rlc3RfZWxlbWVudF91bmFyeS5jYw==) | `97.61% <100.00%> (+0.05%)` | :arrow_up: | | ... and [46 more](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | | ... and [19 files with indirect coverage changes](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1400/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow)