search

NICTA / scoobi

A Scala productivity framework for Hadoop.
http://nicta.github.com/scoobi/
482 stars 97 forks source link

Support Tez as the DAG execution framework #336

Open amalakar opened 10 years ago

amalakar commented 10 years ago

Apache tez[1] enables executing DAG on top of YARN. It has significant performance gains over plain map-reduce. Hive 0.13[2] has seen magnitude of performance improvement by using Tez. Is there any plan of using Tez in scoobi as one of the underlying execution framework?

  1. http://tez.apache.org/
  2. http://www.slideshare.net/hortonworks/apache-hive-013-performance-benchmarks

Attn: @t3rmin4t0r

etorreborre commented 10 years ago

No, there is no such plan right now and we don't currently have the bandwidth to carry such a thing.