moj-analytical-services / etl_manager

A python package to create a database on the platform using our moj data warehousing framework
21 stars 9 forks source link

job runner #23

Open isichei opened 6 years ago

isichei commented 6 years ago

When running a job boto3 should check to see if job of same name is running first before glue job tries to rerun that job. Atm boto3 will throw an error but I think the already running job gets messed up so we need to catch at the beginning of the function call.