search

spe-uob / 2020-HealthcareLake

A reasonably secure data lake for healthcare analytics
MIT License
9 stars 5 forks source link

added library path to glue job #127

Closed armandcismaru closed 3 years ago

armandcismaru commented 3 years ago

used the "--extra-py-files" argument to specify the library path in the glue job and trigger

joekendal commented 3 years ago

@armandcismaru does the path contain the full s3 uri?

armandcismaru commented 3 years ago

I'll check it and fix it today if needed.

armandcismaru commented 3 years ago

Yes, the path contains the full S3 uri, I fixed an instance in aws_glue_job where the bucket name would be repeated twice in script_location.