Closed usik closed 2 years ago
@usik
Changing
destination=f'{inference_input_data}/10k10q') destination=f'{inference_input_data}/articles')
to
destination=f'{inference_input_data.default_value}/10k10q') destination=f'{inference_input_data.default_value}/articles')
(and all subsequent instances of using this object for string interpolation) appears to fix the issue.
Thank you!
Link to the notebook https://github.com/aws/amazon-sagemaker-examples/blob/main/end_to_end/nlp_mlops_company_sentiment/02_nlp_company_earnings_analysis_pipeline.ipynb
Describe the bug While creating a ProcessingStep such as below: create_dataset_step = ProcessingStep( name='HFSECFinBertCreateDataset', processor=create_dataset_processor, outputs=[sagemaker.processing.ProcessingOutput(output_name='report_data', source='/opt/ml/processing/output/10k10q', destination=f'{inference_input_data}/10k10q'), sagemaker.processing.ProcessingOutput(output_name='article_data', source='/opt/ml/processing/output/articles', destination=f'{inference_input_data}/articles')],
ProcessingOutput does not take pipeline parameter as a destination or source. It throws "TypeError: Pipeline variables do not support str operation."
To reproduce A clear, step-by-step set of instructions to reproduce the bug. SageMaker version: 2.88.3 Boto3 version: 1.22.10
Logs If applicable, add logs to help explain your problem. You may also attach an
.ipynb
file to this issue if it includes relevant logs or output.TypeError Traceback (most recent call last)