twitter / summingbird

Streaming MapReduce with Scalding and Storm
https://twitter.com/summingbird
Apache License 2.0
2.14k stars 267 forks source link

call cascading backend to plan writes #762

Closed fwbrasil closed 6 years ago

fwbrasil commented 6 years ago

@ttim This is required for summingbird to work with the new scalding version

fwbrasil commented 6 years ago

the CI won't pass since the branch has a dependency to an older scaling version. I can't change the version to use a new release because we're releasing scalding based on a branch. I tested this patch using the sandbox and it's ok internally cc/ @pankajroark

johnynek commented 6 years ago

we could publish a 0.18.0-RC1 so we could keep the CI here green.

pankajroark commented 6 years ago

@johnynek This branch is just for internal testing right now and we are ok with ci failing for this branch. Let me merge this for now.

pankajroark commented 6 years ago

This is just a personal branch, we can revert easily if there is a reason.