Build system refactor for wheels

[ksivaman]

Description

Refactors the build system in order to support shipping to PyPI.

Type of change

• [ ] Documentation change (change only to the documentation, either a fix or a new content)
• [ ] Bug fix (non-breaking change which fixes an issue)
• [x] New feature (non-breaking change which adds functionality)
• [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Changes

• Introduced an environment variable NVTE_RELEASE_BUILD which controls the release builds. Using this, we can ship a wheels for the common library and the paddle extensions, while shipping source distributions for jax and pytorch.
• Framework level releases can be created using the individual setup files in the framework directories. For the sdist to be installed standalone, any common headers and other tools are copied over locally and added to the search paths in order to be independently installed without the need to build the common lib beforehand.
• Misc small bug fixes and func/var naming changes.
• NOTE: Build experience for users and devs remains unchanged using for the top level setup.py file.

Checklist:

• [x] I have read and followed the contributing guidelines
• [x] The functionality is complete
• [x] I have commented my code, particularly in hard-to-understand areas
• [x] I have made corresponding changes to the documentation
• [x] My changes generate no new warnings
• [x] I have added tests that prove my fix is effective or that my feature works
• [x] New and existing unit tests pass locally with my changes

[ksivaman]

/te-ci

[ksivaman]

Pipeline 15627531