twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.5k stars 708 forks source link

Add a literal cascading filter and map #1742

Closed johnynek closed 6 years ago

johnynek commented 7 years ago

In cascading, we convert all filters and maps to flatMaps.

This means maps have to be boxed into a single iterator just to be thrown away. It is probably worth not doing this if possible.

Also, cascading understands filters separately from flatMaps. By exposing pure filters to cascading, it may make some different planning decisions.