Deepspeed Support

[tylertitsworth]

Description

Customer request to add deepspeed support with OneCCL integration to IPEX MultiNode Container.

Related Issue

MLOPS-2007

Changes Made

• pip reqs to be displayed correctly in docs matrix
• remove unnecessary requirements files from container image
• add apt reqs for deepspeed
• build deepspeed with ops after installing multinode reqs
• add pip reqs for deepspeed
• update ipex-resnet50 test to include deepspeed mode
• add deepspeed integration test
• add deepspeed report test
• [x] The code follows the project's coding standards.
• [x] No Intel Internal IP is present within the changes.
• [x] The documentation has been updated to reflect any changes in functionality.

Validation

All done locally.

• [x] I have tested any changes in container groups locally with test_runner.py with all existing tests passing, and I have added new tests where applicable.

[github-actions[bot]]

Dependency Review

The following issues were found:

• ✅ 0 vulnerable package(s)
• ✅ 0 package(s) with incompatible licenses
• ✅ 0 package(s) with invalid SPDX license definitions
• ⚠️ 1 package(s) with unknown licenses.

See the Details below.

License Issues

pytorch/multinode/requirements.txt

Package	Version	License	Issue Type
oneccl-devel	>= 2021.13.0	Null	Unknown License

OpenSSF Scorecard

Package	Version	Score	Details
pip/mpi4py	>= 3.1.0	:green_circle: 6.2	Details Check Score Reason Maintained :green_circle: 10 30 commit(s) and 12 issue activity found in the last 90 days -- score normalized to 10 Code-Review :warning: 0 Found 0/14 approved changesets -- score normalized to 0 CII-Best-Practices :warning: 0 no effort to earn an OpenSSF best practices badge detected License :green_circle: 10 license file detected Signed-Releases :warning: 0 Project has not signed or included provenance with any releases. Branch-Protection :warning: -1 internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration Dangerous-Workflow :green_circle: 10 no dangerous workflow patterns detected Binary-Artifacts :green_circle: 10 no binaries found in the repo Token-Permissions :green_circle: 10 GitHub workflow tokens follow principle of least privilege Pinned-Dependencies :warning: 0 dependency not pinned by hash detected -- score normalized to 0 Fuzzing :warning: 0 project is not fuzzed Security-Policy :warning: 0 security policy file not detected Vulnerabilities :green_circle: 10 0 existing vulnerabilities detected Packaging :green_circle: 10 packaging workflow detected SAST :green_circle: 10 SAST tool is run on all commits
pip/oneccl-devel	>= 2021.13.0	Unknown	Unknown

Scanned Manifest Files

pytorch/multinode/requirements.txt

• mpi4py@>= 3.1.0
• oneccl-devel@>= 2021.13.0

[github-advanced-security[bot]]

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.