search

yahoo / storm-yarn

Storm-yarn enables Storm clusters to be deployed into machines managed by Hadoop YARN.
Other
417 stars 161 forks source link

when i execute zhe storm-yarn getStormConfig command,it's happen exception. #32

Open hackereye opened 11 years ago

hackereye commented 11 years ago

[bigdata@tbe192168147047 storm-yarn]$ bin/storm-yarn getStormConfig storm.yaml --appId application_1375431632296_0002 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/bigdata/apps/hadoop-2.0.4/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/bigdata/apps/storm-yarn/lib/storm-0.9.0-wip19/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 13/08/02 17:00:00 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited. 13/08/02 17:00:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 13/08/02 17:00:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started. 13/08/02 17:00:01 INFO yarn.StormOnYarn: application report for application_1375431632296_0002 :N/A:0 13/08/02 17:00:01 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1375431632296_0002 13/08/02 17:00:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped. Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0 at backtype.storm.security.auth.ThriftClient.(ThriftClient.java:37) at com.yahoo.storm.yarn.MasterClient.(MasterClient.java:48) at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38) at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113) at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:75) at com.yahoo.storm.yarn.Client.execute(Client.java:139) at com.yahoo.storm.yarn.Client.main(Client.java:145)

anfeng commented 11 years ago

When "storm-yarn getStormConfig" is executed immediately after "storm-yarn launch", YARN may don't have report from storm app master on its host/port. Therefore, it gets a reported port # 0. Please wait a few seconds after "storm-yarn launch".

I have created a new pull request #33 so that storm-yarn will wait for YARN report to be ready.

hackereye commented 11 years ago

in fact;storm-yarn launch failed ,but always can back a application id. . 2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application appattempt_1375681109412_0008_000001 released container container_1375681109412_0008_01_000001 on node: host: tbe192168147049:54841 #containers=0 available=8192 used=0 with event: FINISHED 2013-08-05 14:22:24,453 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1375681109412_0008_000001 State change from LAUNCHED to FAILED 2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1375681109412_0008 failed 1 times due to AM Container for appattempt_1375681109412_0008_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. 2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1375681109412_0008 State change from ACCEPTED to FAILED 2013-08-05 14:22:24,455 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=bigdata OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1375681109412_0008 failed 1 times due to AM Container for appattempt_1375681109412_0008_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. APPID=application_1375681109412_0008

anfeng commented 11 years ago

I plan to merge various changes made in pull request #31 into Master soon. That should make our life easier.

For now, please try the following command to see whether you have any meaningful logs.

yarn logs -applicationId application_1375681109412_0008