search

iconara / bigshift

A tool for moving tables from Redshift to BigQuery
BSD 3-Clause "New" or "Revised" License
65 stars 10 forks source link

aws credentials error with region #24

Open dharamsk opened 5 years ago

dharamsk commented 5 years ago

Giving this a whirl for moving some redshift data to BQ. Thanks for the recent bug fixes.

It looks like this should be something like @config[:aws_credentials].keys?('region')

When I specify region in my aws-credentials.json file, I get the 'match' for nil:NilClass error. Works fine when I remove region.

But since I'm authing to aws using the json file, it assumes I've specified region according to the above code and it fails with AWS Region not specified

dharamsk commented 5 years ago

more info on this: My region was already set in my terminal env AWS_REGION=us-west-1 and was getting pulled in for the upload step, which succeeds. If I unset AWS_REGION, the upload fails with the expected AWS Region not specified error. For some reason, the transfer step fails to authenticate to aws, even though the upload had no problem. Perhaps it isn't an unset region issue, but something else.

iconara commented 5 years ago

What you say makes sense. I don't actively work on this tool, but if you would like to fix it I would gladly review the PR and release a new version.