search

spinatelli / sebc

0 stars 0 forks source link

Install CM #9

Closed spinatelli closed 7 years ago

spinatelli commented 7 years ago

Encountered following error when the CDH Install wizard tries starting the Zookeeper roles:

+ ZOOKEEPER_SERVER_OPTS='-Djava.net.preferIPv4Stack=true -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-ip-172-30-1-8.eu-central-1.compute.internal.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote.port=9010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4194304 -Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/zookeeper_zookeeper-SERVER-b8785f73dfeeefc55e85fd663ca4ebc4_pid29391.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh'
+ exec /usr/java/jdk1.8.0_111/bin/java -cp '/run/cloudera-scm-agent/process/38-zookeeper-server:/opt/cloudera/parcels/CDH-5.7.4-1.cdh5.7.4.p0.2/lib/zookeeper/lib/log4j.jar:/opt/cloudera/parcels/CDH-5.7.4-1.cdh5.7.4.p0.2/lib/zookeeper/build/*:/opt/cloudera/parcels/CDH-5.7.4-1.cdh5.7.4.p0.2/lib/zookeeper/build/lib/*:/opt/cloudera/parcels/CDH-5.7.4-1.cdh5.7.4.p0.2/lib/zookeeper/*:/opt/cloudera/parcels/CDH-5.7.4-1.cdh5.7.4.p0.2/lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/event-publish-5.9.0-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.9.0.jar' -Djava.net.preferIPv4Stack=true -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-ip-172-30-1-8.eu-central-1.compute.internal.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote.port=9010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4194304 -Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/zookeeper_zookeeper-SERVER-b8785f73dfeeefc55e85fd663ca4ebc4_pid29391.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh org.apache.zookeeper.server.quorum.QuorumPeerMain /run/cloudera-scm-agent/process/38-zookeeper-server/zoo.cfg
Invalid config, exiting abnormally

Proceeding without ZK for now and will try to start it afterwards

spinatelli commented 7 years ago

When recreating the cluster, got issues with CM. In the logs I get a whole lot of:

2016-11-18 05:12:29,800 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-SERVICEMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:29,832 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-HOSTMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:30,299 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-EVENTSERVER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:30,432 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-REPORTSMANAGER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:30,560 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-ACTIVITYMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:30,782 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-SERVICEMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:30,821 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-HOSTMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:31,300 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-EVENTSERVER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:31,575 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-REPORTSMANAGER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:31,578 INFO 1096364789@scm-web-3:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-ACTIVITYMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:31,791 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-SERVICEMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:31,832 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-HOSTMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:32,297 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-EVENTSERVER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:32,429 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-REPORTSMANAGER-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:32,564 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-ACTIVITYMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:32,781 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-SERVICEMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
2016-11-18 05:12:32,813 INFO 561434042@scm-web-2:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '__cloudera_internal_user__mgmt-HOSTMONITOR-8e83ae6ad3c0db7d9ebb972bcf18f57c' from 172.30.1.6
spinatelli commented 7 years ago

Tried solving this with Mike, but no results at the moment.

(also tried removing the scm database)

spinatelli commented 7 years ago

Uninstalled agents, restarted CM, installing CDH again. Let's pray.

spinatelli commented 7 years ago

Now getting a problem when trying to install CDH

issue
spinatelli commented 7 years ago

Also getting this when trying to setup Cloudera Management Service

issue2
panwaria commented 7 years ago

Hi @spinatelli , were you able to resolve it? I'm also seeing 'Authentication Failure' in the cloudera-scm-server logs, after I upgraded CM 5.10 from CM 5.9 on my CDH 5.9 cluster.