[aDAG] Support experimental_compile(_custom_nccl_group= nccl_group) API

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

https://ray.io

Apache License 2.0

33.13k stars 5.61k forks source link

[aDAG] Support experimental_compile(_custom_nccl_group= nccl_group) API #47540

Open ruisearch42 opened 2 weeks ago

ruisearch42 commented 2 weeks ago

Description

See https://github.com/ray-project/ray/pull/47141#discussion_r1747392605

Use case

No response

rkooo567 commented 2 weeks ago

this is required before integrating this feature to vllm,

stephanie-wang commented 11 hours ago

@ruisearch42, @AndyUB could take this one if you're busy.

AndyUB commented 10 hours ago

Yup!