search

NVIDIA / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
8.42k stars 1.4k forks source link

Traceable GroupNorm #1835

Closed alpha0422 closed 2 months ago

alpha0422 commented 2 months ago

This PR tries to make GroupNorm can be traced by TorchInductor and don't invoke graph break.

@crcrpar, please take a review, thanks!