Wonong / ab-metadata-pusher

Amundsen databuilder Based containerized metadata pusher
Apache License 2.0
1 stars 0 forks source link

feat: Implement crontab docker, mysql-aws-sqs-publisher #1

Closed Wonong closed 3 years ago

Wonong commented 3 years ago

AWS SQS

Implement publisher which send message to AWS SQS

MySQL ETL - AWS SQS publisher job

Implement a new job whcih extract basic metadata from MySQL DB and publish it to AWS SQS

Crontab docker

Create a dockerfile and shell scripts. When building docker image using publisher.Dockerfile and running it, Container will extract and publish basic metadata from DB. Its configuration is governed by docker.conf file