Netflix / PigPen

Map-Reduce for Clojure
Apache License 2.0
565 stars 55 forks source link

Investigate a read-through storage operator #88

Open mbossenbroek opened 9 years ago

mbossenbroek commented 9 years ago

It would be nice to have a storage operator that would return the data as well. Something that would allow debugging of a script without breaking it into smaller pieces.

(->> (p/load-clj "inp.clj")
        (p/map inc)
        (p/store-and-return-clj "inc.clj")
        (p/map #(* % 2))
        (p/store-and-return-clj "double.clj")
        (p/map #(* % 3)))