Installation Lab

[UNIm95]

Hi. I have created 4 node cluster of m4.large machines on Sunday. So i remove this machines and create 5 m3.xlarge units

[UNIm95]

Error in Cloudera website: wget http://archive.cloudera.com/cm5/installer/5-8-x/cloudera-manager-installer.bin

First: there should be number 5-8-2 Second: there should be dots 5.8.2

Like this: wget http://archive.cloudera.com/cm5/installer/5.8.2/cloudera-manager-installer.bin

[mfernest]

Recognize that the file above is the Path A installer.

[UNIm95]

Thanks. I should first install MariaDB with master and replica, create all databases and only than install CM.

[UNIm95]

Created mariadb with replication.

[UNIm95]

Created databases for:

• Cloudera
  • Activity Monitor
  • Reports Manager
  • Cloudera Navigator Audit Server
  • Cloudera Navigator Metadata Server
  • Sentry
• Hive Metastore Server
• Oozie
• Hue

[UNIm95]

Small edit. Replication doesn't work.

[UNIm95]

Replication works! And it works with all databases needed for Cloudera.

[UNIm95]

Beginning with way 2 installstion of version 5.8.2

[UNIm95]

Creating own cloudera repository with version 5.8.2(cause Cloudera repository admins don't provide versioning of packages in repository)

1. Create new AWS instance with httpd server in same VPC.
2. Download 5.8.2 repository tarball and extract it to /var/www/html
3. Make chmod -R ugo+rX /var/www/html/cm

4. Check what cloudera packages we have:

   [centos@ip-10-0-0-253 yum.repos.d]$sudo yum clean all && yum --showduplicates list  cloudera-manager-server
   Available Packages

   cloudera-manager-server.x86_64 5.8.2-1.cm582.p0.17.el7 myrepo

5. Same check for java

   [centos@ip-10-0-0-253 yum.repos.d]$ yum --showduplicates list  oracle-j2sdk1.7 |expand
   Loaded plugins: fastestmirror
   Loading mirror speeds from cached hostfile
    * base: mirror.trouble-free.net
    * extras: mirror.atlanticmetro.net
    * updates: mirror.vcu.edu
    Available Packages
    oracle-j2sdk1.7.x86_64                  1.7.0+update67-1                  myrepo

6. Install java:

   [centos@ip-10-0-0-253 ~]$ sudo yum install oracle-j2sdk1.7
   Installed:
    oracle-j2sdk1.7.x86_64 0:1.7.0+update67-1                                                                                                                                                      
   
    Complete!

7. Install Cloudera Manager

   [centos@ip-10-0-0-253 ~]$ sudo yum install cloudera-manager-daemons cloudera-manager-server
   Installed:
   cloudera-manager-daemons.x86_64 0:5.8.2-1.cm582.p0.17.el7                                       cloudera-manager-server.x86_64 0:5.8.2-1.cm582.p0.17.el7                                      
   
   Complete!

8. Install Cloudera Manager Agent Packages:

   [centos@ip-10-0-0-253 ~]$ sudo yum install cloudera-manager-agent cloudera-manager-daemons

9. Change cloudera-server settings to use mariadb database

   [root@ip-10-0-0-253 schema]# /usr/share/cmf/schema/scm_prepare_database.sh mysql -h localhost -utemp -ptemp scm scm scm

   For working write to database replication mariadb need binlog-format=row

10. Поехали! (Start!)

    [centos@ip-10-0-0-253 ~]$ sudo service cloudera-scm-server start
    Starting cloudera-scm-server (via systemctl):            [  OK  ]

    IT WORKS!

11. Problems while distributing packages: CentOs 7.2 don't remember disabling transparen_huge_pages and vm.swappines after reboot. Config entries in /etc/sysctl.conf don't help. Also i got such strange message:

      Cloudera supports versions 1.6.0_31 and 1.7.0_55 of Oracle JVM and later. OpenJDK is not supported, and gcj is known to not work. Check the component version table below to identify hosts with unsupported versions of Java.

    This message is strange because java was installed from official cloudera repo!

[UNIm95]

All tasks done