aws-samples / mlops-e2e

MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK
MIT No Attribution
118 stars 77 forks source link

how to get manifest.json.zip ? #1

Closed harshilprajapati96 closed 3 years ago

harshilprajapati96 commented 3 years ago

I'm trying to follow your tutorial, I've created the cloud formation stack and copied the csv to the S3 folder. Not sure where do I get manifest.json.zip?

jessieweiyi commented 3 years ago

Hi Harshil,

The CloudFormation Stack also deployed a [Lambda function](https://github.com/aws-samples/mlops-e2e/blob/main/infrastructure/functions/dataSourceMonitor/index.ts and a Source Data Manifest Bucket. The lambda will be triggered to generate the manifest.json.zip and upload to the data manifest bucket automatically when data is uploaded to the data bucket.

If you go to AWS CodePipeline console, you should see a SourceData step in the Source stage, clicking on the Amazon S3 link should open a browser tab for the manifest.json.zip file S3 location.

Screen Shot 2021-08-18 at 7 18 49 AM