aws / aws-step-functions-data-science-sdk-python

Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS
Apache License 2.0
285 stars 87 forks source link

feat: Support placeholders for TrainingStep #174

Closed ca-nguyen closed 2 years ago

ca-nguyen commented 2 years ago

Description

Add support to define Training parameters dynamically using placeholders in TrainingStep

Fixes #138, #39 and #42

Why is the change necessary?

Currently, it is not possible to use placeholders for Sagemaker Training properties. The properties cannot be defined dynamically, as they need to be defined in the Estimator which does not accept placeholders. This change makes it possible to use placeholders for Training properties by using the parameters field that are passed down from the TrainingStep.

This addresses 3 issues:

Solution

Use the parameters field that is compatible with placeholders to define TrainingStep properties. Merge the parameters that were generated from the Estimator with the input parameters:

Testing

Added unit and integration tests


Pull Request Checklist

Please check all boxes (including N/A items)

Testing

Documentation

Title and description


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license.

StepFunctions-Bot commented 2 years ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository