search

nathanmarz / cascalog

Data processing on Hadoop without the hassle.
Other
1.38k stars 178 forks source link

Prepfn doesn't respect the inner operation type #170

Closed sritchie closed 11 years ago

sritchie commented 11 years ago

Prepfn won't remember that it's wrapping a mapfn, filterfn or mapcatfn. The prepfn macro needs to respect what it's defining, OR we need to create a prepmapfn, prepmapcatfn and prepfilterfn.

sritchie commented 11 years ago

This is actually my bad; you can wrap a prepfn in

(mapcatop (prepfn [_ _] (fn [tuples] ....))

And you're good to go. Note that the inner anonymous function doesn't need to be a serfn.