feature: Add torch_distributed support for Trainium - Githubissues

aws / sagemaker-pytorch-training-toolkit

Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.

Apache License 2.0

197 stars 87 forks source link

feature: Add torch_distributed support for Trainium #248

Closed satishpasumarthi closed 1 year ago

satishpasumarthi commented 1 year ago

Issue #, if available:

Description of changes: Add support for torch_distributed for Trainium instance types

PySDK PR: https://github.com/aws/sagemaker-python-sdk/pull/3424
SM Toolkit PR: https://github.com/aws/sagemaker-training-toolkit/pull/154
Updated sagemaker-training requirement to >=4.3.0 for torch_distributed support.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-toolkit-pr
Commit ID: cc6acb86261cac2a7b133272aee5fb490dfb3cc6
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-gpu-tests
Commit ID: cc6acb86261cac2a7b133272aee5fb490dfb3cc6
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-unit-tests
Commit ID: cc6acb86261cac2a7b133272aee5fb490dfb3cc6
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-pr
Commit ID: cc6acb86261cac2a7b133272aee5fb490dfb3cc6
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-pr
Commit ID: 305c6eb2647ad26b8798e629e879190e485df253
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-gpu-tests
Commit ID: 305c6eb2647ad26b8798e629e879190e485df253
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-toolkit-pr
Commit ID: 305c6eb2647ad26b8798e629e879190e485df253
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-unit-tests
Commit ID: 305c6eb2647ad26b8798e629e879190e485df253
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-pr
Commit ID: a49154270aed86d3fcf24abea3cd3c94a5a474e4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-gpu-tests
Commit ID: a49154270aed86d3fcf24abea3cd3c94a5a474e4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-toolkit-pr
Commit ID: a49154270aed86d3fcf24abea3cd3c94a5a474e4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-pytorch-training-container-unit-tests
Commit ID: a49154270aed86d3fcf24abea3cd3c94a5a474e4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository