search

flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

Local allocator #1386

Closed reyna-abhyankar closed 1 month ago

reyna-abhyankar commented 1 month ago

Description of changes:

Local and tracked allocator

Related Issues:

Linked Issues:

Issues closed by this PR:

This change is Reviewable