PR 227 generates runtime exception in data pipeline when RDS source table is empty - Githubissues

coursera / dataduct

DataPipeline for humans.

Other

252 stars 83 forks source link

PR 227 generates runtime exception in data pipeline when RDS source table is empty #235

Closed p5k6 closed 8 years ago

p5k6 commented 8 years ago

an empty RDS table now generates a runtime exception in its ShellCommandActivity, as split fails (here - https://github.com/coursera/dataduct/pull/227/files#diff-f2f5f005e19551888c4206ecc09edd42R99) when given no input files to work with. Previous (expected - https://github.com/coursera/dataduct/pull/227/files#diff-f2f5f005e19551888c4206ecc09edd42L96) behavior was for ShellCommandActivity to generate a zero-length file to push to s3.

Created PR 234 to correct behavior

p5k6 commented 8 years ago

PR 234 merged, so closing. Thanks guys!