flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.6k stars 219 forks source link

Fix NCCL tear down issue, update docker pre-build cuda version list #1318

Closed goliaro closed 4 months ago

goliaro commented 4 months ago

Description of changes:

Related Issues:

Linked Issues:

Issues closed by this PR:


This change is Reviewable