search

NVIDIA / Fuser

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
Other
229 stars 42 forks source link

Improve perf of `isResharding(Expr*)` #2234

Closed samnordmann closed 4 weeks ago

samnordmann commented 1 month ago

Reimplement isResharding(Expr*) with a pairwise map for better perf. Before this patch, it would use getTvsWithDifferentSharding which creates a computeAtMap, which is too costly. This patch should address https://github.com/Lightning-AI/lightning-thunder/issues/229

samnordmann commented 1 month ago

!build --dist

samnordmann commented 4 weeks ago

!build --dist

wujingyue commented 4 weeks ago

!build --dist