I've created a single step Python transform pipeline that I've activated. After bootstrap, I get an IOError: Dataduct config file is missing. I'm not familiar with the code, but why does Dataduct create a pipeline that uses Dataduct script_runner to execute the pipeline? Why isn't it compiling the YAML to real assets upon validate? Architecture questions aside, what do I need to provide to Dataduct / AWS Data Pipeline to make this work?
I've created a single step Python transform pipeline that I've activated. After bootstrap, I get an
IOError: Dataduct config file is missing
. I'm not familiar with the code, but why does Dataduct create a pipeline that uses Dataductscript_runner
to execute the pipeline? Why isn't it compiling the YAML to real assets upon validate? Architecture questions aside, what do I need to provide to Dataduct / AWS Data Pipeline to make this work?