search

NICTA / scoobi

A Scala productivity framework for Hadoop.
http://nicta.github.com/scoobi/
482 stars 97 forks source link

set libjardir in command line rather than system property #231

Closed zjffdu closed 11 years ago

zjffdu commented 11 years ago

Currently, the libjarsdir is able to been set in System property. You either have to set system property in hadoop-env or in the code at the beginning of your code. This patch is to set the libjarsdir in the command line rather than system property. Because jar will conflit if you use different versions of jars in your job, this often happens when you have production job running and also you are developing new jobs. By setting libjardirs in the command line can enable user to use different versions of jars.

BTW, I notice the scoobi-0.7.0 only support cdh4. And my environment is cdh3, so I make this patch in the cdh3 branch.

etorreborre commented 11 years ago

Hi Jeff, I've added your change but kept the possibility to specify the value using a system property to avoid regressions.

About cdh4 vs cdh3, there is now only a master branch but a patch (b118110) is applied to it by Jenkins when publishing snapshots so that artifacts can also be published for cdh3.

etorreborre commented 11 years ago

BTW the proper CDH3 commit to use now is c50bfa8.