Data module - Githubissues

awslabs / mlmax

Example templates for the delivery of custom ML solutions to production so you can get started quickly without having to make too many design choices.

https://mlmax.readthedocs.io/en/latest/

Apache License 2.0

66 stars 19 forks source link

Data module #63

Closed yinsong1986 closed 3 years ago

yinsong1986 commented 3 years ago

Issue #60 #62:

Description of changes:

Create a data module to generate data pipelines. It supports

Pyspark Sagemaker Processing jobs
Schedule the data pipeline to hourly, daily, weekly or custom intervals
The ability to specify the bucket where the data is read/written to at runtime.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.