search

twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.5k stars 706 forks source link

Adds Execution tutorial #1665

Closed benpence closed 7 years ago

benpence commented 7 years ago

I've been meaning to write this tutorial for a long time. At Twitter, it seems like there's a paucity of understanding of Execution. I don't pretend to be an expert though and would love to hear from other community members about best practices.

Some of the code samples are pretty contrived and could probably use some work.

I'm not too familiar with the cache, so I could definitely use some extra eyes on that.

Also, not sure if how others have differentiated between Scalding "job" and Job.

johnynek commented 7 years ago

This is really great and I'm happy we have better documentation here.

isnotinvain commented 7 years ago

When you're done, you can throw it on here: https://wiki.haskell.org/Monad_tutorials_timeline haha

athuras commented 7 years ago

godspeed

oscar-stripe commented 7 years ago

👍

benpence commented 7 years ago

@oscar-stripe so I didn't add the tut stuff in this PR. I looked at the project and I couldn't figure out a way of showing just part of the code and keeping it compilable. Did you have any suggestions?

johnynek commented 7 years ago

will, you can use ??? liberally, but sure. If you are showing code sketches, we can punt.

On Tue, May 23, 2017 at 11:27 AM Ben Pence notifications@github.com wrote:

@oscar-stripe https://github.com/oscar-stripe so I didn't add the tut stuff in this PR. I looked at the project and I couldn't figure out a way of showing just part of the code and keeping it compilable. Did you have any suggestions?

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/twitter/scalding/pull/1665#issuecomment-303537314, or mute the thread https://github.com/notifications/unsubscribe-auth/AAEJdsR_RNG3Mvj_0GMFRp4uYknUhx6cks5r8083gaJpZM4M7Bp5 .