flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

Sp-ization Algorithm #1423

Open Marsella8 opened 1 week ago

Marsella8 commented 1 week ago

Description of changes:

Added basic sp-ization algorithm and associated tests

Related Issues:

Linked Issues:

Issues closed by this PR:


This change is Reviewable

codecov[bot] commented 1 week ago

Codecov Report

Attention: Patch coverage is 87.98077% with 25 lines in your changes missing coverage. Please review.

Project coverage is 41.93%. Comparing base (d456733) to head (2361d3c). Report is 1 commits behind head on repo-refactor.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## repo-refactor #1423 +/- ## ================================================= + Coverage 39.28% 41.93% +2.65% ================================================= Files 253 255 +2 Lines 8859 9075 +216 Branches 324 346 +22 ================================================= + Hits 3480 3806 +326 + Misses 5379 5269 -110 ``` | [Flag](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | `41.93% <87.98%> (+2.65%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | Coverage Δ | | |---|---|---| | [lib/utils/include/utils/graph/serialparallel.h](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?src=pr&el=tree&filepath=lib%2Futils%2Finclude%2Futils%2Fgraph%2Fserialparallel.h&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL3V0aWxzL2luY2x1ZGUvdXRpbHMvZ3JhcGgvc2VyaWFscGFyYWxsZWwuaA==) | `100.00% <ø> (+100.00%)` | :arrow_up: | | [lib/utils/test/src/test\_sp\_ization.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?src=pr&el=tree&filepath=lib%2Futils%2Ftest%2Fsrc%2Ftest_sp_ization.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL3V0aWxzL3Rlc3Qvc3JjL3Rlc3Rfc3BfaXphdGlvbi5jYw==) | `100.00% <100.00%> (ø)` | | | [lib/utils/src/graph/sp\_ization.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?src=pr&el=tree&filepath=lib%2Futils%2Fsrc%2Fgraph%2Fsp_ization.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL3V0aWxzL3NyYy9ncmFwaC9zcF9pemF0aW9uLmNj) | `91.11% <91.11%> (ø)` | | | [lib/utils/src/graph/serialparallel.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?src=pr&el=tree&filepath=lib%2Futils%2Fsrc%2Fgraph%2Fserialparallel.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL3V0aWxzL3NyYy9ncmFwaC9zZXJpYWxwYXJhbGxlbC5jYw==) | `34.93% <72.22%> (+34.93%)` | :arrow_up: | | [lib/utils/src/graph/algorithms.cc](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423?src=pr&el=tree&filepath=lib%2Futils%2Fsrc%2Fgraph%2Falgorithms.cc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#diff-bGliL3V0aWxzL3NyYy9ncmFwaC9hbGdvcml0aG1zLmNj) | `18.64% <57.69%> (+7.15%)` | :arrow_up: | ... and [11 files with indirect coverage changes](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1423/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow)