moj-analytical-services / etl_manager

A python package to create a database on the platform using our moj data warehousing framework
21 stars 9 forks source link

add proper delete for GlueJob class #28

Closed isichei closed 6 years ago

isichei commented 6 years ago

Something like this

if pre_jobs[t].job_run_state in ['succeeded', 'stopped', 'failed'] :
        pre_jobs[t].delete_s3_job_temp_folder()
        pre_jobs[t].delete_job()
isichei commented 6 years ago

move delete_s3_job_temp_folder() and delete_job() into private functions and then make a single public function.