flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

refactor for softmax, split, topk, transpose #1404

Closed Bob-Chen222 closed 1 month ago

Bob-Chen222 commented 1 month ago

Description of changes:

Refactor for softmax, split, topk, transpose

Related Issues:

Linked Issues:

Issues closed by this PR:


This change is Reviewable

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 41.32%. Comparing base (89cbe93) to head (c46535f).

:exclamation: Current head c46535f differs from pull request most recent head 09c1aa6

Please upload reports for the commit 09c1aa6 to get more accurate results.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## repo-refactor #1404 +/- ## ================================================= + Coverage 38.10% 41.32% +3.22% ================================================= Files 167 181 +14 Lines 5026 5265 +239 Branches 246 271 +25 ================================================= + Hits 1915 2176 +261 + Misses 3111 3089 -22 ``` | [Flag](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1404/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1404/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow) | `41.32% <ø> (+3.22%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow#carryforward-flags-in-the-pull-request-comment) to find out more. [see 223 files with indirect coverage changes](https://app.codecov.io/gh/flexflow/FlexFlow/pull/1404/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=flexflow)