search

vitortoledo93 / SEBC

Cloudera Bootcamp repository
0 stars 0 forks source link

Enterprise Labs #6

Closed vitortoledo93 closed 7 years ago

vitortoledo93 commented 7 years ago

CM Labs

vitortoledo93 commented 7 years ago

What is ubertask optimization? It's a optimization that runs "sufficiently small" sequentially within a single JVM. "Small" is defined by the parameters:

   mapreduce.job.ubertask.maxmaps
   mapreduce.job.ubertask.maxreduces
   mapreduce.job.ubertask.maxbytes

Where in CM is the Kerberos Security Realm value displayed? Administration -> Security -> Kerberos Credentials -> Configurations Or Administration -> Settings -> And click the "Kerberos" Facet to see the Kerberos Configurations Including His Kerberos Security Realm.

Which CDH service(s) host a property for enabling Kerberos authentication? Zookeeper

How do you upgrade the CM agents? Click on Hosts -> All Hosts -> Re-Run Upgrade Wizard -> And select the Yes, I would like to upgrade the Cloudera Manager Agent packages now. Or on the command line:

systemctl stop cloudera-scm-agent
yum upgrade cloudera-manager-agent
systemctl start cloudera-scm-agent

Give the tsquery statement used to chart Hue's CPU utilization?

select cpu_user_rate where roleType=HUE_SERVER

Name all the roles that make up the Hive service:

ZooKeeper:
      Server

    HDFS:

      NameNode
      DataNode

    YARN:
      NodeManager
      ResourceManager

    HIVE:

      Hive Metastore Server
      HiveServer2

What steps must be completed before integrating Cloudera Manager with Kerberos?

Check Your DNS And Reverse DNS Resolution
Configuring a MIT KDC or another KDC
Creating a Cloudera Admin user for Kerberos to Create the Service principal names
Install the krb5-libs and krb5-workstation and openldap-clients on every node
If you are using the AES Encrypt ensure that you have the JCE policy files updated
Configure the /etc/krb5.conf in all the cluster
Making sure the firewall ports are opened.
vitortoledo93 commented 7 years ago

Minotaur's Dashboard image

vitortoledo93 commented 7 years ago

Browse or use curl on the endpoint ./api/v2/cm/deployment:

{
  "timestamp" : "2017-04-06T20:23:10.816Z",
  "clusters" : [ {
    "name" : "Vitortoledo93",
    "version" : "CDH5",
    "services" : [ {
      "name" : "hive",
      "type" : "HIVE",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "HIVEMETASTORE",
          "items" : [ {
            "name" : "hive_metastore_java_heapsize",
            "value" : "609222656"
          } ]
        }, {
          "roleType" : "HIVESERVER2",
          "items" : [ {
            "name" : "hiveserver2_enable_impersonation",
            "value" : "false"
          }, {
            "name" : "hiveserver2_java_heapsize",
            "value" : "609222656"
          }, {
            "name" : "hiveserver2_spark_executor_cores",
            "value" : "4"
          } ]
        } ],
        "items" : [ {
          "name" : "hive_metastore_database_host",
          "value" : "keyrussrprd01.datacentrics.com.br"
        }, {
          "name" : "hive_metastore_database_password",
          "value" : "cloudera-scm"
        }, {
          "name" : "hive_metastore_database_user",
          "value" : "cloudera-scm"
        }, {
          "name" : "mapreduce_yarn_service",
          "value" : "yarn"
        }, {
          "name" : "sentry_service",
          "value" : "sentry"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hive-GATEWAY-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-GATEWAY-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-GATEWAY-a21350ce7727423eb7516e829cd59dcd",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-GATEWAY-baf2c0a42e1167688a30d9bdae9e4187",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "a56209e4-1738-4ccb-999b-3a077a21ca98"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-GATEWAY-ebfb46eba985c134da77bd1e60be6071",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-HIVEMETASTORE-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "HIVEMETASTORE",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "kgovtv5vozr061n3m7svazhq"
          } ]
        }
      }, {
        "name" : "hive-HIVESERVER2-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "HIVESERVER2",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9j8zm52j5egf5asr02tmyzsgp"
          } ]
        }
      } ],
      "displayName" : "Hive"
    }, {
      "name" : "zookeeper",
      "type" : "ZOOKEEPER",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "SERVER",
          "items" : [ {
            "name" : "zookeeper_server_java_heapsize",
            "value" : "609222656"
          } ]
        } ],
        "items" : [ {
          "name" : "enableSecurity",
          "value" : "true"
        } ]
      },
      "roles" : [ {
        "name" : "zookeeper-SERVER-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "e6csmj3n2mueg0xtxohua4hs3"
          }, {
            "name" : "serverId",
            "value" : "2"
          } ]
        }
      }, {
        "name" : "zookeeper-SERVER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "4zd3bli4plt8c9e2a9mdy6gc8"
          }, {
            "name" : "serverId",
            "value" : "1"
          } ]
        }
      }, {
        "name" : "zookeeper-SERVER-ebfb46eba985c134da77bd1e60be6071",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9ezq1apdnno7hrfsegvfsecj5"
          }, {
            "name" : "serverId",
            "value" : "3"
          } ]
        }
      } ],
      "displayName" : "ZooKeeper"
    }, {
      "name" : "hue",
      "type" : "HUE",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "HUE_LOAD_BALANCER",
          "items" : [ {
            "name" : "ssl_certificate",
            "value" : "/opt/cloudera/security/pki/cmhost.pem"
          }, {
            "name" : "ssl_certificate_key",
            "value" : "/opt/cloudera/security/pki/cmhost.pem"
          } ]
        }, {
          "roleType" : "HUE_SERVER",
          "items" : [ {
            "name" : "hue_http_port",
            "value" : "9888"
          }, {
            "name" : "hue_server_bind_wildcard",
            "value" : "true"
          } ]
        } ],
        "items" : [ {
          "name" : "database_host",
          "value" : "keyrussrprd01.datacentrics.com.br"
        }, {
          "name" : "database_password",
          "value" : "cloudera-scm"
        }, {
          "name" : "database_type",
          "value" : "mysql"
        }, {
          "name" : "database_user",
          "value" : "cloudera-scm"
        }, {
          "name" : "hive_service",
          "value" : "hive"
        }, {
          "name" : "hue_webhdfs",
          "value" : "hdfs-HTTPFS-2e4e89eaa656c0a8625ea4de1f3efe53"
        }, {
          "name" : "oozie_service",
          "value" : "oozie"
        }, {
          "name" : "sentry_service",
          "value" : "sentry"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hue-HUE_LOAD_BALANCER-a21350ce7727423eb7516e829cd59dcd",
        "type" : "HUE_LOAD_BALANCER",
        "hostRef" : {
          "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9yoa2aoa6lp7l2g0i2r80aoaf"
          } ]
        }
      }, {
        "name" : "hue-HUE_SERVER-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "HUE_SERVER",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9z7vwvkd9wjyqcm9ay8eb8c0x"
          }, {
            "name" : "secret_key",
            "value" : "JrrkYTwNP5T8snbJ2QWXqJ7iCC44Fb"
          } ]
        }
      }, {
        "name" : "hue-HUE_SERVER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "HUE_SERVER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "2j1wxwjmswwpkd493ti90fqim"
          }, {
            "name" : "secret_key",
            "value" : "yUO77p8gaMHhgV7lkaA9ZKC5Iogeug"
          } ]
        }
      }, {
        "name" : "hue-KT_RENEWER-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "KT_RENEWER",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "bpomvt19go6b134cj1bkccd7j"
          } ]
        }
      }, {
        "name" : "hue-KT_RENEWER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "KT_RENEWER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "45hamz99ojbpuzca24vazsl3r"
          } ]
        }
      } ],
      "displayName" : "Hue"
    }, {
      "name" : "oozie",
      "type" : "OOZIE",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "OOZIE_SERVER",
          "items" : [ {
            "name" : "oozie_database_host",
            "value" : "keyrussrprd01.datacentrics.com.br"
          }, {
            "name" : "oozie_database_password",
            "value" : "cloudera-scm"
          }, {
            "name" : "oozie_database_type",
            "value" : "mysql"
          }, {
            "name" : "oozie_database_user",
            "value" : "cloudera-scm"
          }, {
            "name" : "oozie_java_heapsize",
            "value" : "609222656"
          } ]
        } ],
        "items" : [ {
          "name" : "hive_service",
          "value" : "hive"
        }, {
          "name" : "mapreduce_yarn_service",
          "value" : "yarn"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "oozie-OOZIE_SERVER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "OOZIE_SERVER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "4r84jqo2d8hylurpy1cqj299h"
          } ]
        }
      } ],
      "displayName" : "Oozie"
    }, {
      "name" : "yarn",
      "type" : "YARN",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "GATEWAY",
          "items" : [ {
            "name" : "mapred_reduce_tasks",
            "value" : "8"
          }, {
            "name" : "mapred_submit_replication",
            "value" : "2"
          } ]
        }, {
          "roleType" : "JOBHISTORY",
          "items" : [ {
            "name" : "mr2_jobhistory_java_heapsize",
            "value" : "609222656"
          } ]
        }, {
          "roleType" : "NODEMANAGER",
          "items" : [ {
            "name" : "yarn_nodemanager_heartbeat_interval_ms",
            "value" : "100"
          }, {
            "name" : "yarn_nodemanager_local_dirs",
            "value" : "/yarn/nm"
          }, {
            "name" : "yarn_nodemanager_log_dirs",
            "value" : "/yarn/container-logs"
          }, {
            "name" : "yarn_nodemanager_resource_cpu_vcores",
            "value" : "4"
          }, {
            "name" : "yarn_nodemanager_resource_memory_mb",
            "value" : "5951"
          } ]
        }, {
          "roleType" : "RESOURCEMANAGER",
          "items" : [ {
            "name" : "resource_manager_java_heapsize",
            "value" : "609222656"
          }, {
            "name" : "yarn_scheduler_maximum_allocation_mb",
            "value" : "5951"
          }, {
            "name" : "yarn_scheduler_maximum_allocation_vcores",
            "value" : "4"
          } ]
        } ],
        "items" : [ {
          "name" : "hadoop_secure_web_ui",
          "value" : "true"
        }, {
          "name" : "hdfs_service",
          "value" : "hdfs"
        }, {
          "name" : "rm_dirty",
          "value" : "true"
        }, {
          "name" : "zk_authorization_secret_key",
          "value" : "hLBQlfvzO0w13FLfzgnKoxQpXjnOHg"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "yarn-JOBHISTORY-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "JOBHISTORY",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "7e19gjcem7teqmrd19tpnty00"
          } ]
        }
      }, {
        "name" : "yarn-NODEMANAGER-a21350ce7727423eb7516e829cd59dcd",
        "type" : "NODEMANAGER",
        "hostRef" : {
          "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "4be4ybbn5nsder1wumz7vg1sn"
          } ]
        }
      }, {
        "name" : "yarn-NODEMANAGER-baf2c0a42e1167688a30d9bdae9e4187",
        "type" : "NODEMANAGER",
        "hostRef" : {
          "hostId" : "a56209e4-1738-4ccb-999b-3a077a21ca98"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "cxsfuwixlkubcxepytakopr6x"
          } ]
        }
      }, {
        "name" : "yarn-NODEMANAGER-ebfb46eba985c134da77bd1e60be6071",
        "type" : "NODEMANAGER",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9gx9bilh7438xmal8iiamv0pe"
          } ]
        }
      }, {
        "name" : "yarn-RESOURCEMANAGER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "RESOURCEMANAGER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "rm_id",
            "value" : "51"
          }, {
            "name" : "role_jceks_password",
            "value" : "dpwq6dlpx0h2pdejtxgmmc69b"
          } ]
        }
      } ],
      "displayName" : "YARN (MR2 Included)"
    }, {
      "name" : "hdfs",
      "type" : "HDFS",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "BALANCER",
          "items" : [ {
            "name" : "balancer_java_heapsize",
            "value" : "609222656"
          } ]
        }, {
          "roleType" : "DATANODE",
          "items" : [ {
            "name" : "dfs_data_dir_list",
            "value" : "/home/dfs/dn"
          }, {
            "name" : "dfs_datanode_data_dir_perm",
            "value" : "700"
          }, {
            "name" : "dfs_datanode_du_reserved",
            "value" : "5366087680"
          }, {
            "name" : "dfs_datanode_http_port",
            "value" : "1006"
          }, {
            "name" : "dfs_datanode_port",
            "value" : "1004"
          } ]
        }, {
          "roleType" : "GATEWAY",
          "items" : [ {
            "name" : "dfs_client_use_trash",
            "value" : "true"
          } ]
        }, {
          "roleType" : "JOURNALNODE",
          "items" : [ {
            "name" : "dfs_journalnode_edits_dir",
            "value" : "/home/dfs/jn"
          } ]
        }, {
          "roleType" : "NAMENODE",
          "items" : [ {
            "name" : "dfs_name_dir_list",
            "value" : "/home/dfs/nn"
          }, {
            "name" : "dfs_namenode_servicerpc_address",
            "value" : "8022"
          }, {
            "name" : "namenode_java_heapsize",
            "value" : "609222656"
          }, {
            "name" : "role_config_suppression_namenode_java_heapsize_minimum_validator",
            "value" : "true"
          } ]
        }, {
          "roleType" : "SECONDARYNAMENODE",
          "items" : [ {
            "name" : "fs_checkpoint_dir_list",
            "value" : "/dfs/snn"
          }, {
            "name" : "secondary_namenode_java_heapsize",
            "value" : "609222656"
          } ]
        } ],
        "items" : [ {
          "name" : "dfs_encrypt_data_transfer_algorithm",
          "value" : "AES/CTR/NoPadding"
        }, {
          "name" : "dfs_ha_fencing_cloudera_manager_secret_key",
          "value" : "f7Nj3rnTduUWeYGLt5YHXdE5CeHf6A"
        }, {
          "name" : "dfs_ha_fencing_methods",
          "value" : "shell(true)"
        }, {
          "name" : "fc_authorization_secret_key",
          "value" : "PFaEKzbFXkpBmOKZHkbXalJ7bZJilB"
        }, {
          "name" : "hadoop_secure_web_ui",
          "value" : "true"
        }, {
          "name" : "hadoop_security_authentication",
          "value" : "kerberos"
        }, {
          "name" : "hadoop_security_authorization",
          "value" : "true"
        }, {
          "name" : "http_auth_signature_secret",
          "value" : "z26IeLHa9NX3JplhYZNESIlqHYR4BV"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hdfs-BALANCER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "BALANCER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-DATANODE-a21350ce7727423eb7516e829cd59dcd",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9o29vgoda58r7msj4hjacs0tb"
          } ]
        }
      }, {
        "name" : "hdfs-DATANODE-baf2c0a42e1167688a30d9bdae9e4187",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "a56209e4-1738-4ccb-999b-3a077a21ca98"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "d45wpkkrr8r3jyxo5vvqhz217"
          } ]
        }
      }, {
        "name" : "hdfs-DATANODE-ebfb46eba985c134da77bd1e60be6071",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "1w84diakmr2b60zue1oyx6kwg"
          } ]
        }
      }, {
        "name" : "hdfs-FAILOVERCONTROLLER-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "FAILOVERCONTROLLER",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "8r4g8g65tub80zsj7fr1jqi0g"
          } ]
        }
      }, {
        "name" : "hdfs-FAILOVERCONTROLLER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "FAILOVERCONTROLLER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "3l9i39jrehtt15ylk0i20fj4q"
          } ]
        }
      }, {
        "name" : "hdfs-HTTPFS-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "HTTPFS",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "24a5momxyxl4a0juhw6mur2ck"
          } ]
        }
      }, {
        "name" : "hdfs-JOURNALNODE-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "JOURNALNODE",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "3ggvwf7fl3kdzoi5hd6aizeyn"
          } ]
        }
      }, {
        "name" : "hdfs-JOURNALNODE-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "JOURNALNODE",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "9ma1l03wsqlnnma0x0b3q56by"
          } ]
        }
      }, {
        "name" : "hdfs-JOURNALNODE-ebfb46eba985c134da77bd1e60be6071",
        "type" : "JOURNALNODE",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "706z3d7pnbo7blmguq12n8c84"
          } ]
        }
      }, {
        "name" : "hdfs-NAMENODE-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "NAMENODE",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ {
            "name" : "autofailover_enabled",
            "value" : "true"
          }, {
            "name" : "dfs_federation_namenode_nameservice",
            "value" : "nameservice1"
          }, {
            "name" : "dfs_namenode_quorum_journal_name",
            "value" : "nameservice1"
          }, {
            "name" : "namenode_id",
            "value" : "61"
          }, {
            "name" : "role_jceks_password",
            "value" : "9ouoyx6qke5fjwnl3pfj09dla"
          } ]
        }
      }, {
        "name" : "hdfs-NAMENODE-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "NAMENODE",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "autofailover_enabled",
            "value" : "true"
          }, {
            "name" : "dfs_federation_namenode_nameservice",
            "value" : "nameservice1"
          }, {
            "name" : "dfs_namenode_quorum_journal_name",
            "value" : "nameservice1"
          }, {
            "name" : "namenode_id",
            "value" : "53"
          }, {
            "name" : "role_jceks_password",
            "value" : "1m5tlgo9hiznlkpzd84kbj4s3"
          } ]
        }
      } ],
      "displayName" : "HDFS"
    }, {
      "name" : "sentry",
      "type" : "SENTRY",
      "config" : {
        "roleTypeConfigs" : [ {
          "roleType" : "SENTRY_SERVER",
          "items" : [ {
            "name" : "sentry_server_java_heapsize",
            "value" : "268435456"
          } ]
        } ],
        "items" : [ {
          "name" : "hdfs_service",
          "value" : "hdfs"
        }, {
          "name" : "sentry_server_database_host",
          "value" : "keyrussrprd01.datacentrics.com.br"
        }, {
          "name" : "sentry_server_database_password",
          "value" : "sentry_password"
        }, {
          "name" : "sentry_service_admin_group",
          "value" : "hive,impala,hue,solr,kafka,vitortoledo93"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "sentry-GATEWAY-2e4e89eaa656c0a8625ea4de1f3efe53",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "sentry-GATEWAY-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "sentry-GATEWAY-a21350ce7727423eb7516e829cd59dcd",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "sentry-GATEWAY-baf2c0a42e1167688a30d9bdae9e4187",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "a56209e4-1738-4ccb-999b-3a077a21ca98"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "sentry-GATEWAY-ebfb46eba985c134da77bd1e60be6071",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "sentry-SENTRY_SERVER-98ca43442faa627d80c0f3e97c9c263b",
        "type" : "SENTRY_SERVER",
        "hostRef" : {
          "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
        },
        "config" : {
          "items" : [ {
            "name" : "role_jceks_password",
            "value" : "46o30x3caeinel4hk7puep8dt"
          } ]
        }
      } ],
      "displayName" : "Sentry"
    } ]
  } ],
  "hosts" : [ {
    "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090",
    "ipAddress" : "172.16.62.2",
    "hostname" : "keyrussrprd01.datacentrics.com.br",
    "rackId" : "/default",
    "config" : {
      "items" : [ {
        "name" : "host_config_suppression_memory_overcommitted_validator",
        "value" : "true"
      } ]
    }
  }, {
    "hostId" : "20d081ed-7cf3-4eb5-970d-f59c19f2afbe",
    "ipAddress" : "172.16.62.3",
    "hostname" : "keyrussrprd02.datacentrics.com.br",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "1984ec6e-524b-4191-bc47-c465d224e70f",
    "ipAddress" : "172.16.62.4",
    "hostname" : "keyrussrprd03.datacentrics.com.br",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "a56209e4-1738-4ccb-999b-3a077a21ca98",
    "ipAddress" : "172.16.62.5",
    "hostname" : "keyrussrprd04.datacentrics.com.br",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "c9972a13-8373-4542-85c9-b20b9b5b8d77",
    "ipAddress" : "172.16.62.6",
    "hostname" : "keyrussrprd05.datacentrics.com.br",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  } ],
  "users" : [ {
    "name" : "__cloudera_internal_user__mgmt-ACTIVITYMONITOR-98ca43442faa627d80c0f3e97c9c263b",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "34b2cd75e5c64c8aff764266e867617ca19722837d5e38b8f69b934bc355b868",
    "pwSalt" : -6643948733816204677,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-EVENTSERVER-98ca43442faa627d80c0f3e97c9c263b",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "e20e5ce6c7810405fb7a4a9b41b9a3ff768c1b19f7b681a347d61695d5bdd8ec",
    "pwSalt" : 7145216463314260418,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-HOSTMONITOR-98ca43442faa627d80c0f3e97c9c263b",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "250071cf492776cfbf26bd8d0547ad4c459265bb66aec6d8734e8852fe750f7c",
    "pwSalt" : 1074547324322157649,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-REPORTSMANAGER-98ca43442faa627d80c0f3e97c9c263b",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "e21a6ad447ba8809b60877dbacb56c48f7b722cd9352869daaf2b5e2f84b1aaa",
    "pwSalt" : 6297692174083494620,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-SERVICEMONITOR-98ca43442faa627d80c0f3e97c9c263b",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "47d77f2e0c2b61149dcf3be6ade0483df1cd47d7ddfd7e88fc7916c9c95edab0",
    "pwSalt" : 8416842144457743801,
    "pwLogin" : true
  }, {
    "name" : "admin",
    "roles" : [ "ROLE_LIMITED" ],
    "pwHash" : "a4f63e2f34b611a1bf80f1ee109c48f7c61b07519c61d34078b470c3065db0b9",
    "pwSalt" : 2926119035787778626,
    "pwLogin" : true
  }, {
    "name" : "vitortoledo93",
    "roles" : [ "ROLE_ADMIN" ],
    "pwHash" : "d0c3c048d5e451543837edca6f5e1368b011b792156d6f6a2dee7e5e11a85584",
    "pwSalt" : 3816288685042122597,
    "pwLogin" : true
  } ],
  "versionInfo" : {
    "version" : "5.10.1",
    "buildUser" : "jenkins",
    "buildTimestamp" : "20170319-2001",
    "gitHash" : "f226435f6fa5f545543c00245900ae43bea7a29c",
    "snapshot" : false
  },
  "managementService" : {
    "name" : "mgmt",
    "type" : "MGMT",
    "config" : {
      "roleTypeConfigs" : [ {
        "roleType" : "ACTIVITYMONITOR",
        "items" : [ {
          "name" : "firehose_database_host",
          "value" : "keyrussrprd01.datacentrics.com.br"
        }, {
          "name" : "firehose_database_name",
          "value" : "amon"
        }, {
          "name" : "firehose_database_password",
          "value" : "cloudera-scm"
        }, {
          "name" : "firehose_database_user",
          "value" : "cloudera-scm"
        }, {
          "name" : "firehose_heapsize",
          "value" : "609222656"
        } ]
      }, {
        "roleType" : "EVENTSERVER",
        "items" : [ {
          "name" : "event_server_heapsize",
          "value" : "609222656"
        } ]
      }, {
        "roleType" : "HOSTMONITOR",
        "items" : [ {
          "name" : "firehose_non_java_memory_bytes",
          "value" : "1610612736"
        } ]
      }, {
        "roleType" : "REPORTSMANAGER",
        "items" : [ {
          "name" : "headlamp_database_host",
          "value" : "keyrussrprd01.datacentrics.com.br"
        }, {
          "name" : "headlamp_database_name",
          "value" : "rman"
        }, {
          "name" : "headlamp_database_password",
          "value" : "cloudera-scm"
        }, {
          "name" : "headlamp_database_user",
          "value" : "cloudera-scm"
        }, {
          "name" : "headlamp_heapsize",
          "value" : "609222656"
        } ]
      }, {
        "roleType" : "SERVICEMONITOR",
        "items" : [ {
          "name" : "firehose_non_java_memory_bytes",
          "value" : "1610612736"
        } ]
      } ],
      "items" : [ {
        "name" : "ssl_client_truststore_location",
        "value" : "/usr/java/jdk1.7.0_67-cloudera/jre/lib/security/jssecacerts"
      }, {
        "name" : "ssl_client_truststore_password",
        "value" : "changeit"
      } ]
    },
    "roles" : [ {
      "name" : "mgmt-ACTIVITYMONITOR-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "ACTIVITYMONITOR",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "62sjyhmgx77d15z7bu8m447rg"
        } ]
      }
    }, {
      "name" : "mgmt-ALERTPUBLISHER-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "ALERTPUBLISHER",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "6gd39ni0lzzy0xj75zyp9eit6"
        } ]
      }
    }, {
      "name" : "mgmt-EVENTSERVER-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "EVENTSERVER",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "dlcnmj3ttdnnp4475k33y29tv"
        } ]
      }
    }, {
      "name" : "mgmt-HOSTMONITOR-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "HOSTMONITOR",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "8x3imyw7avnws10mooycz1ilg"
        } ]
      }
    }, {
      "name" : "mgmt-REPORTSMANAGER-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "REPORTSMANAGER",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "5ke1aioxkmvt5tsitla7b68ic"
        } ]
      }
    }, {
      "name" : "mgmt-SERVICEMONITOR-98ca43442faa627d80c0f3e97c9c263b",
      "type" : "SERVICEMONITOR",
      "hostRef" : {
        "hostId" : "c91ebc5c-b242-4c12-9a7f-a3df28887090"
      },
      "config" : {
        "items" : [ {
          "name" : "role_jceks_password",
          "value" : "7mg3na62naip530vb94f45e21"
        } ]
      }
    } ],
    "displayName" : "Cloudera Management Service"
  },
  "managerSettings" : {
    "items" : [ {
      "name" : "AD_USE_SIMPLE_AUTH",
      "value" : "false"
    }, {
      "name" : "AGENT_TLS",
      "value" : "true"
    }, {
      "name" : "CLUSTER_STATS_START",
      "value" : "10/24/2012 19:40"
    }, {
      "name" : "KDC_ADMIN_PASSWORD",
      "value" : "BQIAAABKAAIAEERBVEFDRU5UUklDUy5DT00ADGNsb3VkZXJhLXNjbQAFYWRtaW4AAAABWOU6eQEAFwAQ6Jf8GFkO8iQ3Th9kv9hVtQAAAAE="
    }, {
      "name" : "KDC_ADMIN_USER",
      "value" : "cloudera-scm/admin@DATACENTRICS.COM"
    }, {
      "name" : "KDC_HOST",
      "value" : "keyrussrprd01.datacentrics.com.br"
    }, {
      "name" : "KEYSTORE_PASSWORD",
      "value" : "cloudera"
    }, {
      "name" : "KEYSTORE_PATH",
      "value" : "/opt/cloudera/security/jks/cmhost-keystore.jks/"
    }, {
      "name" : "MAX_RENEW_LIFE",
      "value" : "604800"
    }, {
      "name" : "PUBLIC_CLOUD_STATUS",
      "value" : "NOT_ON_PUBLIC_CLOUD"
    }, {
      "name" : "REMOTE_PARCEL_REPO_URLS",
      "value" : "https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,https://archive.cloudera.com/navigator-keytrustee5/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/"
    }, {
      "name" : "SECURITY_REALM",
      "value" : "DATACENTRICS.COM"
    }, {
      "name" : "TRUSTSTORE_PASSWORD",
      "value" : "changeit"
    }, {
      "name" : "TRUSTSTORE_PATH",
      "value" : "/usr/java/jdk1.7.0_67-cloudera/jre/lib/security/jssecacerts"
    }, {
      "name" : "WEB_TLS",
      "value" : "true"
    } ]
  }
}
vitortoledo93 commented 7 years ago

Write curl statements that stop, start, and check the current state of your Hive service:

Stop Command:

curl -X POST -u "vitortoledo93:cloudera" -i https://localhost:7183/api/v2/clusters/cluster/services/hive/commands/stop
output:
HTTP/1.1 200 OK
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: CLOUDERA_MANAGER_SESSIONID=yhpcpkkmpt39atdzussuzfy2;Path=/;Secure;HttpOnly
Content-Type: application/json
Date: Fri, 07 Apr 2017 05:47:41 GMT
Transfer-Encoding: chunked
Server: Jetty(6.1.26.cloudera.4)

{
  "id" : 1084,
  "name" : "Stop",
  "startTime" : "2017-04-07T05:47:41.682Z",
  "active" : true,
  "serviceRef" : {
    "clusterName" : "cluster",
    "serviceName" : "hive"
  }

Checking the hive service status after stop command via CM API:

curl -u "vitortoledo93:cloudera" -i https://localhost:7183/api/v2/clusters/cluster/services/hive/

HTTP/1.1 200 OK
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: CLOUDERA_MANAGER_SESSIONID=1wbji06pnsdcdb3dmioc4nx34;Path=/;Secure;HttpOnly
Content-Type: application/json
Date: Fri, 07 Apr 2017 05:49:53 GMT
Transfer-Encoding: chunked
Server: Jetty(6.1.26.cloudera.4)

{
  "name" : "hive",
  "type" : "HIVE",
  "clusterRef" : {
    "clusterName" : "cluster"
  },
  "serviceUrl" : "https://keyrussrprd01.datacentrics.com.br:7183/cmf/serviceRedirect/hive",
  "serviceState" : "STOPPED",
  "healthSummary" : "DISABLED",
  "healthChecks" : [ {
    "name" : "HIVE_HIVEMETASTORES_HEALTHY",
    "summary" : "DISABLED"
  }, {
    "name" : "HIVE_HIVESERVER2S_HEALTHY",
    "summary" : "DISABLED"
  } ],
  "configStale" : false,
  "maintenanceMode" : false,
  "maintenanceOwners" : [ ],
  "displayName" : "Hive"

Start Command:

curl -X POST -u "vitortoledo93:cloudera"  -i https://localhost:7183/api/v2/clusters/cluster/services/hive/commands/start
HTTP/1.1 200 OK
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: CLOUDERA_MANAGER_SESSIONID=cd10azvsk3ydkwmkdzhptxn;Path=/;Secure;HttpOnly
Content-Type: application/json
Date: Fri, 07 Apr 2017 05:53:39 GMT
Transfer-Encoding: chunked
Server: Jetty(6.1.26.cloudera.4)

{
  "id" : 1090,
  "name" : "Start",
  "startTime" : "2017-04-07T05:53:39.543Z",
  "active" : true,
  "serviceRef" : {
    "clusterName" : "cluster",
    "serviceName" : "hive"
  }

Checking the hive service status after Start command via CM API:


curl -u "vitortoledo93:cloudera" --insecure -i https://localhost:7183/api/v2/clusters/cluster/services/hive/
HTTP/1.1 200 OK
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: CLOUDERA_MANAGER_SESSIONID=dur2gn2qnpjcam5di8wkcokc;Path=/;Secure;HttpOnly
Content-Type: application/json
Date: Fri, 07 Apr 2017 05:55:00 GMT
Transfer-Encoding: chunked
Server: Jetty(6.1.26.cloudera.4)

{
  "name" : "hive",
  "type" : "HIVE",
  "clusterRef" : {
    "clusterName" : "cluster"
  },
  "serviceUrl" : "https://keyrussrprd01.datacentrics.com.br:7183/cmf/serviceRedirect/hive",
  "serviceState" : "STARTED",
  "healthSummary" : "GOOD",
  "healthChecks" : [ {
    "name" : "HIVE_HIVEMETASTORES_HEALTHY",
    "summary" : "GOOD"
  }, {
    "name" : "HIVE_HIVESERVER2S_HEALTHY",
    "summary" : "GOOD"
  } ],
  "configStale" : false,
  "maintenanceMode" : false,
  "maintenanceOwners" : [ ],
  "displayName" : "Hive"