search

spring-attic / spring-xd-ambari

Apache Ambari integration for Spring XD
Apache License 2.0
9 stars 18 forks source link

Yarn Resource Manager HA #9

Open ysung-pivotal opened 9 years ago

ysung-pivotal commented 9 years ago

in PHD3/HDP2.2, Yarn resource manager HA is available. We might need another script to detect if yarn_resource_ha is enabled or not.

jvalkeal commented 9 years ago

Don't understand what you mean. Did you try to use PR https://github.com/spring-projects/spring-xd-ambari/pull/7? Current master or what's available from yum repos doesn't support HA.

ysung-pivotal commented 9 years ago

Yes. Thanks.

jvalkeal commented 9 years ago

Oh I misread the title, this was about rm ha, not about namenode. How config is different if rm is ha?

ysung-pivotal commented 9 years ago

From yarn ha doc, the min settings we need for yarn-client to identify logical yarn resource manager:

yarn.resourcemanager.ha.enabled=true yarn.resourcemanager.cluster-id=yarn-cluster yarn.resourcemanager.ha.rm-ids=rm1,rm2 yarn.resourcemanager.hostname.rm1=rm1_fqdn:23140 yarn.resourcemanager.scheduler.address.rm1=rm1_fqdn:23130 yarn.resourcemanager.webapp.address.rm2=rm1_fqdn:23188 yarn.resource.resource-tracker.address.rm1=rm1_fqdn:23125 yarn.resourcemanager.hostname.rm2=rm2_fqdn:23140 yarn.resourcemanager.admin.address.rm1=rm1_fqdn:23141 yarn.resourcemanager.scheduler.address.rm1=rm2_fqdn:23130 yarn.resourcemanager.webapp.address.rm2=rm2_fqdn:23188 yarn.resource.resource-tracker.address.rm2=rm2_fqdn:23125 yarn.resourcemanager.admin.address.rm2=rm2_fqdn:23141 yarn.resourcemanager.zk-address=zk1:2181,zk2:2181,zk3:2181 yarn.resourcemanager.recovery.enabled=true yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore

sureshcoder commented 8 years ago

Any plan for fixing this issue?

ghost commented 7 years ago

So do we have rm ha available for any spring xD version? Couldn't find any documentation, thanks.