search

mwira / SEBC

0 stars 0 forks source link

Installation Lab #1

Closed mwira closed 6 years ago

mwira commented 6 years ago

I have started the EC2 instance and I am using CENTOS 7X release1803.

5 Instances are created at m4xlarge.

I am at pre-install check:

  1. vm.swappiness is set to 1
  2. showed mount attributes
  3. check on ext file mount 4.disable transparent_hugepage
  4. List your network interface configuration
  5. Show that forward and reverse host lookups are correctly resolved
  6. enable nscd
  7. enable ntpd

command and screenshot are provided at 1_preinstall.md

mwira commented 6 years ago

after pre-install check... since I am using centOS/RHEL i have selected mariadb for my external database.

For Maria DB Installation I have followed these steps:

  1. $ sudo yum install mariadb-server
  2. Configure Mariadb as per https://www.cloudera.com/documentation/enterprise/latest/topics/install_cm_mariadb.html#install_cm_mariadb_config
  3. Based on https://www.cloudera.com/documentation/enterprise/latest/topics/install_cm_mariadb.html#install_cm_mariadb_newdbs I have configured the database for the following services
    • Cloudera Manager (cms)
    • Activity Monitor
    • Report Manager
    • Hive metastore
    • Sentry server
    • Navigator server
    • Navigator metastore server
    • Oozie
    • Hue

I have also installed mysql connector to all instances /usr/share/java/

For details please refer to 2_replica_working.md

mwira commented 6 years ago

I have followed the installation based on the following page instruction https://www.cloudera.com/documentation/enterprise/5-12-x/topics/cm_ig_install_path_b.html

download cloudera-manager.repo and scp it to machine/instance 54.169.208.182 install jdk1.7 sudo yum install oracle-j2sdk1.7 install latest cloudera manager sudo yum install cloudera-manager-daemons cloudera-manager-server and run it sudo service cloudera-scm-server start

mwira commented 6 years ago

after cloudera manager is installed I proceed with installing cdh 5.14

I have not installed any of the additional components...

I have opened some issues in installation ... as i realise i may i have taken some shortcut which are not best practice and would need some guidance:

  1. I have to open all the tcp port (from AWS EC2 security group console) as I was not able to have the different instances communicate with each other
  2. I also have to manually change owner or permission for some of the folder such as zookeeper (I discover SElinux was enforced after the fact but perhaps disabling this earlier would have solved all this -- please note that with SELinux disabled/permissive i am still having some port issues)

cloudera manager is installed (based on snapshot)