cloudera / cm_api

Cloudera Manager API Client
Apache License 2.0
305 stars 284 forks source link

cm_shell: feature enhancement to show configs #54

Open kmizumar opened 7 years ago

kmizumar commented 7 years ago

Added a new feature to show configuration parameters in Cloudera Manager Shell.

Welcome to the Cloudera Manager Console
Select a cluster using 'show clusters' and 'use'
cloudera> use Cluster 1
Connected to Cluster 1
Cluster 1> show configs HDFS-1
+---------+----------------------------------------------+----------------------------------------------------+
| SERVICE | NAME                                         | VALUE                                              |
+---------+----------------------------------------------+----------------------------------------------------+
| HDFS-1  | dfs_data_transfer_protection                 | privacy                                            |
| HDFS-1  | hdfs_hadoop_ssl_enabled                      | true                                               |
| HDFS-1  | hadoop_security_authorization                | true                                               |
| HDFS-1  | zookeeper_service                            | ZOOKEEPER-1                                        |
| HDFS-1  | ssl_server_keystore_password                 | cloudera                                           |
| HDFS-1  | hdfs_sentry_sync_enable                      | true                                               |
| HDFS-1  | hadoop_security_authentication               | kerberos                                           |
| HDFS-1  | kms_service                                  | KMS-1                                              |
| HDFS-1  | dfs_datanode_read_shortcircuit               | true                                               |
| HDFS-1  | dfs_namenode_acls_enabled                    | true                                               |
| HDFS-1  | dfs_datanode_hdfs_blocks_metadata_enabled    | true                                               |
| HDFS-1  | ssl_server_keystore_keypassword              | cloudera                                           |
| HDFS-1  | hdfs_blocks_with_corrupt_replicas_thresholds | {"warning":"2.5","critical":"3.0"}                 |
| HDFS-1  | dfs_encrypt_data_transfer_algorithm          | AES/CTR/NoPadding                                  |
| HDFS-1  | ssl_server_keystore_location                 | /etc/cdep-ssl-conf/CA_STANDARD/hadoop-keystore.jks |
| HDFS-1  | ssl_client_truststore_password               | cloudera                                           |
| HDFS-1  | dfs_encrypt_data_transfer                    | true                                               |
| HDFS-1  | hadoop_rpc_protection                        | privacy                                            |
| HDFS-1  | dfs_ha_fencing_methods                       | shell(true)                                        |
| HDFS-1  | dfs_replication                              | 3                                                  |
| HDFS-1  | ssl_client_truststore_location               | /etc/cdep-ssl-conf/CA_STANDARD/truststore.jks      |
+---------+----------------------------------------------+----------------------------------------------------+
Cluster 1>
kmizumar commented 7 years ago

Modified to show role type configurations:

Cluster 1> show configs HDFS-1
+---------+--------------------+---------------------------------------------------------------------------+--------------------------------------------------------------------------+
| SERVICE | ROLETYPE           | NAME                                                                      | VALUE                                                                    |
+---------+--------------------+---------------------------------------------------------------------------+--------------------------------------------------------------------------+
| HDFS-1  |                    | dfs_data_transfer_protection                                              | privacy                                                                  |
| HDFS-1  |                    | hdfs_hadoop_ssl_enabled                                                   | true                                                                     |
| HDFS-1  |                    | hadoop_security_authorization                                             | true                                                                     |
| HDFS-1  |                    | zookeeper_service                                                         | ZOOKEEPER-1                                                              |
| HDFS-1  |                    | ssl_server_keystore_password                                              | cloudera                                                                 |
| HDFS-1  |                    | hdfs_sentry_sync_enable                                                   | true                                                                     |
| HDFS-1  |                    | hadoop_security_authentication                                            | kerberos                                                                 |
| HDFS-1  |                    | kms_service                                                               | KMS-1                                                                    |
| HDFS-1  |                    | dfs_datanode_read_shortcircuit                                            | true                                                                     |
| HDFS-1  |                    | dfs_namenode_acls_enabled                                                 | true                                                                     |
| HDFS-1  |                    | dfs_datanode_hdfs_blocks_metadata_enabled                                 | true                                                                     |
| HDFS-1  |                    | ssl_server_keystore_keypassword                                           | cloudera                                                                 |
| HDFS-1  |                    | hdfs_blocks_with_corrupt_replicas_thresholds                              | {"warning":"2.5","critical":"3.0"}                                       |
| HDFS-1  |                    | dfs_encrypt_data_transfer_algorithm                                       | AES/CTR/NoPadding                                                        |
| HDFS-1  |                    | ssl_server_keystore_location                                              | /etc/cdep-ssl-conf/CA_STANDARD/hadoop-keystore.jks                       |
| HDFS-1  |                    | ssl_client_truststore_password                                            | cloudera                                                                 |
| HDFS-1  |                    | dfs_encrypt_data_transfer                                                 | true                                                                     |
| HDFS-1  |                    | hadoop_rpc_protection                                                     | privacy                                                                  |
| HDFS-1  |                    | dfs_ha_fencing_methods                                                    | shell(true)                                                              |
| HDFS-1  |                    | dfs_replication                                                           | 3                                                                        |
| HDFS-1  |                    | ssl_client_truststore_location                                            | /etc/cdep-ssl-conf/CA_STANDARD/truststore.jks                            |
| HDFS-1  | FAILOVERCONTROLLER | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | FAILOVERCONTROLLER | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | FAILOVERCONTROLLER | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | FAILOVERCONTROLLER | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | JOURNALNODE        | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | JOURNALNODE        | journalnode_edits_directory_free_space_percentage_thresholds              | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | JOURNALNODE        | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | JOURNALNODE        | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | JOURNALNODE        | dfs_journalnode_edits_dir                                                 | /dfs/jn                                                                  |
| HDFS-1  | JOURNALNODE        | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | JOURNALNODE        | journalnode_edits_directory_free_space_absolute_thresholds                | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | HTTPFS             | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | HTTPFS             | httpfs_https_keystore_file                                                | /etc/cdep-ssl-conf/CA_STANDARD/httpfs-keystore.jks                       |
| HDFS-1  | HTTPFS             | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | HTTPFS             | httpfs_https_keystore_password                                            | cloudera                                                                 |
| HDFS-1  | HTTPFS             | httpfs_https_truststore_password                                          | cloudera                                                                 |
| HDFS-1  | HTTPFS             | httpfs_https_truststore_file                                              | /etc/cdep-ssl-conf/CA_STANDARD/truststore.jks                            |
| HDFS-1  | HTTPFS             | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | HTTPFS             | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | HTTPFS             | httpfs_use_ssl                                                            | true                                                                     |
| HDFS-1  | SECONDARYNAMENODE  | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | SECONDARYNAMENODE  | secondarynamenode_checkpoint_directories_free_space_absolute_thresholds   | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | SECONDARYNAMENODE  | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | SECONDARYNAMENODE  | fs_checkpoint_dir_list                                                    | /dfs/snn                                                                 |
| HDFS-1  | SECONDARYNAMENODE  | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | SECONDARYNAMENODE  | secondarynamenode_checkpoint_directories_free_space_percentage_thresholds | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | SECONDARYNAMENODE  | dfs_secondary_http_port                                                   | 20201                                                                    |
| HDFS-1  | SECONDARYNAMENODE  | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | SECONDARYNAMENODE  | secondary_namenode_java_heapsize                                          | 606076928                                                                |
| HDFS-1  | SECONDARYNAMENODE  | dfs_secondary_https_port                                                  | 20202                                                                    |
| HDFS-1  | BALANCER           | balancer_java_heapsize                                                    | 606076928                                                                |
| HDFS-1  | DATANODE           | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | DATANODE           | dfs_datanode_https_port                                                   | 20004                                                                    |
| HDFS-1  | DATANODE           | datanode_data_directories_free_space_absolute_thresholds                  | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | DATANODE           | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | DATANODE           | dfs_datanode_data_dir_perm                                                | 700                                                                      |
| HDFS-1  | DATANODE           | dfs_datanode_du_reserved                                                  | 10736126771                                                              |
| HDFS-1  | DATANODE           | dfs_datanode_http_port                                                    | 1006                                                                     |
| HDFS-1  | DATANODE           | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | DATANODE           | datanode_java_heapsize                                                    | 1073741824                                                               |
| HDFS-1  | DATANODE           | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | DATANODE           | datanode_config_safety_valve                                              |                                                                          |
|         |                    |                                                                           |         <property>                                                       |
|         |                    |                                                                           |           <name>dfs.thrift.datanode.address</name>                       |
|         |                    |                                                                           |           <value>0.0.0.0:20005</value>                                   |
|         |                    |                                                                           |           <description>                                                  |
|         |                    |                                                                           |             The address where the Thrift datanode server will listen to. |
|         |                    |                                                                           |             If the port is 0 then the server will start on a free port.  |
|         |                    |                                                                           |           </description>                                                 |
|         |                    |                                                                           |         </property>                                                      |
| HDFS-1  | DATANODE           | dfs_datanode_max_locked_memory                                            | 1404043264                                                               |
| HDFS-1  | DATANODE           | dfs_data_dir_list                                                         | /dfs/dn                                                                  |
| HDFS-1  | DATANODE           | dfs_datanode_failed_volumes_tolerated                                     | 0                                                                        |
| HDFS-1  | DATANODE           | dfs_datanode_ipc_port                                                     | 20001                                                                    |
| HDFS-1  | DATANODE           | datanode_data_directories_free_space_percentage_thresholds                | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | DATANODE           | dfs_datanode_port                                                         | 20002                                                                    |
| HDFS-1  | NFSGATEWAY         | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NFSGATEWAY         | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NFSGATEWAY         | nfsgateway_dump_directory_free_space_percentage_thresholds                | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NFSGATEWAY         | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NFSGATEWAY         | nfsgateway_dump_directory_free_space_absolute_thresholds                  | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NFSGATEWAY         | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NAMENODE           | log_directory_free_space_percentage_thresholds                            | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NAMENODE           | namenode_data_directories_free_space_percentage_thresholds                | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NAMENODE           | dfs_name_dir_list                                                         | /dfs/nn                                                                  |
| HDFS-1  | NAMENODE           | log_directory_free_space_absolute_thresholds                              | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NAMENODE           | dfs_namenode_servicerpc_address                                           | 8022                                                                     |
| HDFS-1  | NAMENODE           | heap_dump_directory_free_space_percentage_thresholds                      | {"critical":"10.0","warning":"20.0"}                                     |
| HDFS-1  | NAMENODE           | dfs_namenode_handler_count                                                | 30                                                                       |
| HDFS-1  | NAMENODE           | dfs_http_port                                                             | 20101                                                                    |
| HDFS-1  | NAMENODE           | dfs_namenode_service_handler_count                                        | 30                                                                       |
| HDFS-1  | NAMENODE           | heap_dump_directory_free_space_absolute_thresholds                        | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NAMENODE           | namenode_data_directories_free_space_absolute_thresholds                  | {"critical":"never","warning":"never"}                                   |
| HDFS-1  | NAMENODE           | namenode_java_heapsize                                                    | 606076928                                                                |
| HDFS-1  | NAMENODE           | dfs_https_port                                                            | 20102                                                                    |
| HDFS-1  | GATEWAY            | hdfs_client_config_safety_valve                                           |                                                                          |
| HDFS-1  | GATEWAY            | dfs_client_use_trash                                                      | true                                                                     |
+---------+--------------------+---------------------------------------------------------------------------+--------------------------------------------------------------------------+
Cluster 1>