Pipeline Object Definition doesn't include NotebookStep

[simis2626]

AWS released Notebook Steps https://aws.amazon.com/about-aws/whats-new/2023/11/api-creating-amazon-sagemaker-notebook-jobs/

but the API object description here: https://aws-sagemaker-mlops.github.io/sagemaker-model-building-pipeline-definition-JSON-schema/#Steps Doesn't include NotebookSteps

This documentation is linked to by the official CloudFormation documentation, and makes it tough to deploy one of these NotebookStep Pipelines via CFN. https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-pipeline-pipelinedefinition.html#cfn-sagemaker-pipeline-pipelinedefinition-pipelinedefinitionbody

Please update the doco to include the new NotebookStep API Object.

[simis2626]

Worth noting too that the documentation in this repo is also the canonical reference for the SageMaker API Reference on the Pipeline API Object https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreatePipeline.html#sagemaker-CreatePipeline-request-PipelineDefinition

[suyashdb]

@simis2626 how did you get this working without the notebook job step schema?

[simis2626]

@suyashdb unfortunately I didn’t. I was doing this as an experiment to try out the feature but it wasn’t for a mission critical workload. Instead I’ve just parked it until this issue is resolved.