search

twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.49k stars 703 forks source link

Scalding Operations should use the hadoop API for counters, not scalding #1846

Open johnynek opened 6 years ago

johnynek commented 6 years ago

we have seen some issues with the scalding side-effect based counter API:

see #1716

Scalding Operations use counters to log cache hit-rate effectiveness. We should just use the normal hadoop/cascading access for this.