search

coursera / dataduct

DataPipeline for humans.
Other
252 stars 82 forks source link

Support for `workerGroup` field #128

Closed darkcrawler01 closed 8 years ago

darkcrawler01 commented 9 years ago

WorkerGroup gives the flexibility of using existing EC2 instances and not spinning up new instance to do the work. From the reading the docs, I found that this valuable feature is not supported by dataduct yet. Any reason for not supporting this yet ?

http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-how-task-runner-user-managed.html

sb2nov commented 9 years ago

@darkcrawler01 this is just something we haven't had a chance to build yet. But I'll keep it in mind for any future release of dataduct.

sb2nov commented 8 years ago

Fixed in #182

darkcrawler01 commented 8 years ago

thanks ! i will try it out this weekend