Open StudyingShao opened 2 weeks ago
Hi @phu0ngng @cyanguwa , this PR is the Permutation fusion operators needed by MoE.
Please ignore the unit test file tests/pytorch/test_permutation.py
, and help to review other changes. Thanks.
I will start to refactor the unit test file in parallel.
cc @QiZhangNV
/te-ci pytorch
Hi @StudyingShao, thanks for putting this work into TE. I have a couple of suggestions after the first glance at your code.
Description
Permutation for fp32/bf16/fp16/fp8 data type. Now PyTorch op only.
Additional descriptions: https://github.com/fanshiqing/moe_grouped_gemm/tree/dev
Type of change
Changes
Please list the changes introduced in this PR:
Checklist: