search

flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k stars 218 forks source link

Refactor Utility tasks #1354

Open reyna-abhyankar opened 3 months ago

reyna-abhyankar commented 3 months ago

Utility tasks should use task spec interface so they can also be executed locally