twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.49k stars 703 forks source link

Make arguments to TypedPipes transient #1831

Closed johnynek closed 6 years ago

johnynek commented 6 years ago

This should help in some cases when a TypedPipe gets swept into a closure. If we are serializing a TypedPipe, it is never needed, since the code that runs on the mappers/reducers has already been planned, and TypedPipes are for planning.

We are running this PR at Stripe, so it seems safe.

johnynek commented 6 years ago

@ianoc @fwbrasil ptal?