Closed hubertlu-tw closed 1 year ago
We can further improve the build time by separating out the newly-enabled extensions which are included in --cuda_ext extension by default as follows: | Extension Name |
---|---|
--focal_loss | |
--index_mul_2d | |
--transducer | |
--peer_memory | |
--nccl_p2p |
This is great! I see that the CI job were already installing ninja, but with this PR, they use ninja for the build eg: http://ml-ci.amd.com:21096/job/pytorch/job/apex-rocm-pytorch-release/211 : 36min
building 'apex_C' extension
creating /apex/build/temp.linux-x86_64-3.7
creating /apex/build/temp.linux-x86_64-3.7/csrc
Emitting ninja build file /apex/build/temp.linux-x86_64-3.7/build.ninja...
vs
http://ml-ci.amd.com:21096/job/pytorch/job/apex-rocm-pytorch-release/209 : 1hr1min
Build Apex with the original setup.py (with and without ninja for
gfx900;gfx906;gfx908;gfx90a;gfx1030
) on a system with the default MAX_JOBS=32 with the following two commands:1. pip install
2. python setup.py install
The extensions built in the experiment:
Comparison of installation time:
Original
PR