nathanmarz / storm-deploy

One click deploy for Storm clusters on AWS
Other
516 stars 148 forks source link

lein1 is used for deploying storm <0.9.0, otherwise lein2 is used. #48

Closed lorcan closed 10 years ago

lorcan commented 10 years ago

Addresses a bug identified by Ryan Ebanks on the mailing list. The storm-deploy process was dying because earlier versions of storm were expecting lein1 (e.g., 0.8.2) and storm-deploy was defaulting to lein2 regardless of storm version. This fix makes lein1 a dependency if using pre 0.9.0 storm and lein2 otherwise.

vipulneo commented 10 years ago

nope I am using lein 2.3.3 but it fails for the installation command "lein deploy-storm --start --name mycluster --branch 0.9.0"

Compiling storm.trident.testing Exception in thread "main" java.lang.ClassNotFoundException: backtype.storm.LocalDRPC, compiling:(testing.clj:1) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3387) at clojure.lang.Compiler.compile1(Compiler.java:7035) at clojure.lang.Compiler.compile1(Compiler.java:7025) at clojure.lang.Compiler.compile(Compiler.java:7097) at clojure.lang.RT.compile(RT.java:387) at clojure.lang.RT.load(RT.java:427) at clojure.la ERROR logging - ng.RT.load(RT.java:400) at clojure.core$load$fn4890.invoke(core.clj:5415) at clojure.core$load.doInvoke(core.clj:5414) at clojure.lang.RestFn.invoke(RestFn.java:408) at clojure.core$load_one.invoke(core.clj:5227) at clojure.core$compile$fn__4895.invoke(core.clj:5426) at clojure.core$compile.invoke(core.clj:5425) at user$eval9.invoke(form-init8357392993879539425.clj:1) at clojure.lang.Compiler.eval(Compiler.java:6511) at clojure.lang.Compiler.eval(Compiler.java:6501) at clojure.lang.Compiler.load(Compiler.java:6952) at clojure.lang.Compiler.loadFile(Compiler.java:6912) at clojure.main$load_script.invoke(main.clj:283) at clojure.main$init_opt.invoke(main.clj:288) at clojure.main$initialize.invoke(main.clj:316) at clojure.main$null_opt.invoke(main.clj:349) at clojure.main$main.doInvoke(main.clj:427) at clojure.lang.RestFn.invoke(RestFn.java:421) at clojure.lang.Var.invoke(Var.java:419) at clojure.lang.AFn.applyToHelper(AFn.java:163) at clojure.lang.Var.applyTo(Var.java:532) at clojure.main.main(main.java:37) Caused by: java.lang.ClassNotFoundException: backtype.storm.LocalDRPC at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at clojure.lang.DynamicClassLoader.findClass(DynamicClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:188) at storm.trident.testing$loading4784auto.invoke(testing.clj:1) at clojure.lang.AFn.applyToHelper(AFn.java:159) at clojure.lang.AFn.applyTo(AFn.java:151) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3382) ... 27 more Compilation failed: Subprocess failed Error encountered performing task 'jar' with profile(s): 'release' Suppressed exit Build storm failed logout ERROR logging - at pallet.core$raise_on_error$fn5204.invoke(core.clj:526) ERROR logging - at pallet.core$middleware_handler$fn__5197.invoke(core.clj:495) ERROR logging - at pallet.core$apply_phase_to_node.invoke(core.clj:656) ERROR logging - at pallet.core$eval5367$fn5368$iter53695373$fn5374$fn5379.invoke(core.clj:721) ERROR logging - at clojure.lang.AFn.call(AFn.java:18) ERROR logging - at java.util.concurrent.FutureTask.run(FutureTask.java:262) ERROR logging - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ERROR logging - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ERROR logging - at java.lang.Thread.run(Thread.java:724) INFO execute - Output: 204.236.163.163 Note: /home/storm/build/storm/src/jvm/backtype/storm/coordination/CoordinatedBolt.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details.

INFO execute - Output: 204.236.163.163 Compiling storm.trident.testing Exception in thread "main" java.lang.ClassNotFoundException: backtype.storm.LocalDRPC, compiling:(testing.clj:1) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3387) at clojure.lang.Compiler.compile1(Compiler.java:7035) at clojure.lang.Compiler.compile1(Compiler.java:7025) at clojure.lang.Compiler.compile(Compiler.java:7097) at clojure.lang.RT.compile(RT.java:387) at clojure.lang.RT.load(RT.java:427) at clojure.lang.RT.load(RT.java:400) at clojure.core$load$fn4890.invoke(core.clj:5415) at clojure.core$load.doInvoke(core.clj:5414) at clojure.lang.RestFn.invoke(RestFn.java:408) at clojure.core$load_one.invoke(core.clj:5227) at clojure.core$compile$fn__4895.invoke(core.clj:5426) at clojure.core$compile.invoke(core.clj:5425) at user$eval9.invoke(form-init184167227634743405.clj:1) at clojure.lang.Compiler.eval(Compiler.java:6511) at clojure.lang.Compiler.eval(Compiler.java:6501) at clojure.lang.Compiler.load(Compiler.java:6952) at clojure.lang.Compiler.loadFile(Compiler.java:6912) at clojure.main$load_script.invoke(main.clj:283) at clojure.main$init_opt.invoke(main.clj:288) at clojure.main$initialize.invoke(main.clj:316) at clojure.main$null_opt.invoke(main.clj:349) at clojure.main$main.doInvoke(main.clj:427) at clojure.lang.RestFn.invoke(RestFn.java:421) at clojure.lang.Var.invoke(Var.java:419) at clojure.lang.AFn.applyToHelper(AFn.java:163) at clojure.lang.Var.applyTo(Var.java:532) at clojure.main.main(main.java:37) Caused by: java.lang.ClassNotFoundException: backtype.storm.LocalDRPC at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at clojure.lang.DynamicClassLoader.findClass(DynamicClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:188) at storm.trident.testing$loading4784auto.invoke(testing.clj:1) at clojure.lang.AFn.applyToHelper(AFn.java:159) at clojure.lang.AFn.applyTo(AFn.java:151) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3382) ... 27 more Compilation failed: Subprocess failed Error encountered performing task 'jar' with profile(s): 'release' Suppressed exit Build storm failed logout

and so on...

msegel commented 10 years ago

Try --commit 0.9.0-rc2

Sent from my iPhone

On Nov 11, 2013, at 11:19 AM, vipulneo notifications@github.com wrote:

nope I am using lein 2.3.3 but it fails for the installation command "lein deploy-storm --start --name mycluster --branch 0.9.0"

Compiling storm.trident.testing Exception in thread "main" java.lang.ClassNotFoundException: backtype.storm.LocalDRPC, compiling:(testing.clj:1) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3387) at clojure.lang.Compiler.compile1(Compiler.java:7035) at clojure.lang.Compiler.compile1(Compiler.java:7025) at clojure.lang.Compiler.compile(Compiler.java:7097) at clojure.lang.RT.compile(RT.java:387) at clojure.lang.RT.load(RT.java:427) at clojure.la ERROR logging - ng.RT.load(RT.java:400) at clojure.core$load$fn4890.invoke(core.clj:5415) at clojure.core$load.doInvoke(core.clj:5414) at clojure.lang.RestFn.invoke(RestFn.java:408) at clojure.core$load_one.invoke(core.clj:5227) at clojure.core$compile$fn__4895.invoke(core.clj:5426) at clojure.core$compile.invoke(core.clj:5425) at user$eval9.invoke(form-init8357392993879539425.clj:1) at clojure.lang.Compiler.eval(Compiler.java:6511) at clojure.lang.Compiler.eval(Compiler.java:6501) at clojure.lang.Compiler.load(Compiler.java:6952) at clojure.lang.Compiler.loadFile(Compiler.java:6912) at clojure.main$load_script.invoke(main.clj:283) at clojure.main$init_opt.invoke(main.clj:288) at clojure.main$initialize.invoke(main.clj:316) at clojure.main$null_opt.invoke(main.clj:349) at clojure.main$main.doInvoke(main.clj:427) at clojure.lang.RestFn.invoke(RestFn.java:421) at clojure.lang.Var.invoke(Var.java:419) at clojure.lang.AFn.applyToHelper(AFn.java:163) at clojure.lang.Var.applyTo(Var.java:532) at clojure.main.main(main.java:37) Caused by: java.lang.ClassNotFoundException: backtype.storm.LocalDRPC at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at clojure.lang.DynamicClassLoader.findClass(DynamicClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:188) at storm.trident.testing$loading4784auto.invoke(testing.clj:1) at clojure.lang.AFn.applyToHelper(AFn.java:159) at clojure.lang.AFn.applyTo(AFn.java:151) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3382) ... 27 more Compilation failed: Subprocess failed Error encountered performing task 'jar' with profile(s): 'release' Suppressed exit Build storm failed logout ERROR logging - at pallet.core$raise_on_error$fn5204.invoke(core.clj:526) ERROR logging - at pallet.core$middleware_handler$fn__5197.invoke(core.clj:495) ERROR logging - at pallet.core$apply_phase_to_node.invoke(core.clj:656) ERROR logging - at pallet.core$eval5367$fn5368$iter53695373$fn5374$fn5379.invoke(core.clj:721) ERROR logging - at clojure.lang.AFn.call(AFn.java:18) ERROR logging - at java.util.concurrent.FutureTask.run(FutureTask.java:262) ERROR logging - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ERROR logging - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ERROR logging - at java.lang.Thread.run(Thread.java:724) INFO execute - Output: 204.236.163.163 Note: /home/storm/build/storm/src/jvm/backtype/storm/coordination/CoordinatedBolt.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details.

INFO execute - Output: 204.236.163.163 Compiling storm.trident.testing Exception in thread "main" java.lang.ClassNotFoundException: backtype.storm.LocalDRPC, compiling:(testing.clj:1) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3387) at clojure.lang.Compiler.compile1(Compiler.java:7035) at clojure.lang.Compiler.compile1(Compiler.java:7025) at clojure.lang.Compiler.compile(Compiler.java:7097) at clojure.lang.RT.compile(RT.java:387) at clojure.lang.RT.load(RT.java:427) at clojure.lang.RT.load(RT.java:400) at clojure.core$load$fn4890.invoke(core.clj:5415) at clojure.core$load.doInvoke(core.clj:5414) at clojure.lang.RestFn.invoke(RestFn.java:408) at clojure.core$load_one.invoke(core.clj:5227) at clojure.core$compile$fn__4895.invoke(core.clj:5426) at clojure.core$compile.invoke(core.clj:5425) at user$eval9.invoke(form-init184167227634743405.clj:1) at clojure.lang.Compiler.eval(Compiler.java:6511) at clojure.lang.Compiler.eval(Compiler.java:6501) at clojure.lang.Compiler.load(Compiler.java:6952) at clojure.lang.Compiler.loadFile(Compiler.java:6912) at clojure.main$load_script.invoke(main.clj:283) at clojure.main$init_opt.invoke(main.clj:288) at clojure.main$initialize.invoke(main.clj:316) at clojure.main$null_opt.invoke(main.clj:349) at clojure.main$main.doInvoke(main.clj:427) at clojure.lang.RestFn.invoke(RestFn.java:421) at clojure.lang.Var.invoke(Var.java:419) at clojure.lang.AFn.applyToHelper(AFn.java:163) at clojure.lang.Var.applyTo(Var.java:532) at clojure.main.main(main.java:37) Caused by: java.lang.ClassNotFoundException: backtype.storm.LocalDRPC at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at clojure.lang.DynamicClassLoader.findClass(DynamicClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:188) at storm.trident.testing$loading4784auto.invoke(testing.clj:1) at clojure.lang.AFn.applyToHelper(AFn.java:159) at clojure.lang.AFn.applyTo(AFn.java:151) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3382) ... 27 more Compilation failed: Subprocess failed Error encountered performing task 'jar' with profile(s): 'release' Suppressed exit Build storm failed logout

and so on...

— Reply to this email directly or view it on GitHub.

vipulneo commented 10 years ago

Thanks finally it worked..

rbnks commented 10 years ago

I can confirm that this fixed my issue where storm 0.8.2 was not deploying correctly. Thanks lorcan. Sorry for the delayed reply.

-Ryan

lorcan commented 10 years ago

Great, thanks @rbnks. @tbatchelli, can we get this pulled in? It fixes a bug in storm-deploy when deploying storm<0.9.0.