search

microsoft / vidur

A large-scale simulation framework for LLM inference
MIT License
231 stars 22 forks source link

About Splitwise branch #21

Open deanhzm opened 1 month ago

deanhzm commented 1 month ago

Has the Splitwise branch been fully updated? I noticed some logic changes in the SplitwiseGlobalScheduler, but it seems that there are no adjustments made for PD separation in other areas, including the event.

AgrawalAmey commented 1 month ago

@deanhzm i had started working on the branch, but didn't find enough time to complete it.

deanhzm commented 1 month ago

Thank you for your reply! Is there any plan to further promote this branch in the future? We are very much looking forward to this branch because of its significance for the simulation study of distributed systems.

atumanov commented 1 month ago

would you be interested in contributing this feature @deanhzm ?