fix: Slight improvements on step decorator and notebook job step notebooks - Githubissues

aws / amazon-sagemaker-examples

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

https://sagemaker-examples.readthedocs.io

Apache License 2.0

10.04k stars 6.75k forks source link

fix: Slight improvements on step decorator and notebook job step notebooks #4572

Open qidewenwhen opened 7 months ago

qidewenwhen commented 7 months ago

Issue #, if available:

The basic-pipeline-batch-inference.ipynb notebook failed in the distribution image for the version conflicts:

ValueError: Mismatched version between the Python package and the native shared object.  Python package version: 1.7.1. Shared object version: 1.7.6. Shared object is loaded from: /opt/conda/lib/libxgboost.so.
Likely cause:
  * XGBoost is first installed with anaconda then upgraded with pip. To fix it please remove one of the installations.

To fix it, we should update the xgboost version restriction to be xgboost>=1.7.1 in requirements.txt and allow auto version upgrade while installing dependencies in requirements.txt.

Description of changes: Slight improvements on step decorator and notebook job step notebooks including:

Update notebooks to consume latest sdk: %pip install -r ./requirements.txt -U
Update the xgboost version in the requirements.txt in batch notebook to be xgboost>=1.7.1 to fix version conflicts in cosmos image
Update gitignore to ignore the notebook output files
Rephrase the words in the Setup section in notebook job step notebook as it's confusing

Testing done: notebook tests

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

[X] I have read the CONTRIBUTING doc and adhered to the example notebook best practices
[X] I have updated any necessary documentation, including READMEs
[X] I have tested my notebook(s) and ensured it runs end-to-end
[X] I have linted my notebook(s) and code using black-nb -l 100 {path}/{notebook-name}.ipynb

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

review-notebook-app[bot] commented 7 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: e9711decc7bde9c7e19b661ede0d6f318dca4fe7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: e9711decc7bde9c7e19b661ede0d6f318dca4fe7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: e9711decc7bde9c7e19b661ede0d6f318dca4fe7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: e9711decc7bde9c7e19b661ede0d6f318dca4fe7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: 67faa4451e4b70396c0b0b6a5e229fd3952fcab3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: 67faa4451e4b70396c0b0b6a5e229fd3952fcab3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: 67faa4451e4b70396c0b0b6a5e229fd3952fcab3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: 67faa4451e4b70396c0b0b6a5e229fd3952fcab3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: 90937bc4e2cb868458f865b915d50aa0d2aad429
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: 90937bc4e2cb868458f865b915d50aa0d2aad429
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: 90937bc4e2cb868458f865b915d50aa0d2aad429
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: 90937bc4e2cb868458f865b915d50aa0d2aad429
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: 5f1e1669abfd062e3bec9a9cff828882d6a0bbde
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: 5f1e1669abfd062e3bec9a9cff828882d6a0bbde
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: 5f1e1669abfd062e3bec9a9cff828882d6a0bbde
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: 5f1e1669abfd062e3bec9a9cff828882d6a0bbde
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: e0231e073c372faa87a646f6e28c1339d0ffe9c9
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: e0231e073c372faa87a646f6e28c1339d0ffe9c9
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: e0231e073c372faa87a646f6e28c1339d0ffe9c9
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: e0231e073c372faa87a646f6e28c1339d0ffe9c9
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: c23035d66281dc9d9b03cdd652466d31ea8b1a8e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: c23035d66281dc9d9b03cdd652466d31ea8b1a8e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: c23035d66281dc9d9b03cdd652466d31ea8b1a8e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 7 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: c23035d66281dc9d9b03cdd652466d31ea8b1a8e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: 61bd687d1631c3765469bea83d805a6f742b415b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: 61bd687d1631c3765469bea83d805a6f742b415b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: 61bd687d1631c3765469bea83d805a6f742b415b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: 61bd687d1631c3765469bea83d805a6f742b415b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: d58bf1c982ad51ba1b5fa99772b837c30bba6d4c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: d58bf1c982ad51ba1b5fa99772b837c30bba6d4c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: d58bf1c982ad51ba1b5fa99772b837c30bba6d4c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: d58bf1c982ad51ba1b5fa99772b837c30bba6d4c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: cf7cc0570f0b767f0a1701c9d2417591b506735e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: cf7cc0570f0b767f0a1701c9d2417591b506735e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: cf7cc0570f0b767f0a1701c9d2417591b506735e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: cf7cc0570f0b767f0a1701c9d2417591b506735e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-link-check
Commit ID: 9b099dd09c17e2acfabe4ff618855299ca6279ad
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-code-formatting
Commit ID: 9b099dd09c17e2acfabe4ff618855299ca6279ad
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-sagemaker-examples-grammar
Commit ID: 9b099dd09c17e2acfabe4ff618855299ca6279ad
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 6 months ago

AWS CodeBuild CI Report

CodeBuild project: SageMakerNotebooksProd-USWEST2-amazon-sagemaker-examples-pr
Commit ID: 9b099dd09c17e2acfabe4ff618855299ca6279ad
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository