flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

Hip Refactor for optimizer, partition and pool #1379

Closed Bob-Chen222 closed 1 month ago

Bob-Chen222 commented 2 months ago

Description of changes:

add optimizer, partition, pool hip refactor

Related Issues:

Linked Issues:

Issues closed by this PR:


This change is Reviewable