NetApp / harvest

Open-metrics endpoint for ONTAP and StorageGRID
https://netapp.github.io/harvest/latest
Apache License 2.0
147 stars 36 forks source link

Harvest should only collect counters used in dashboards #2386

Closed cgrinds closed 8 months ago

cgrinds commented 11 months ago

There are a few levels to this:

  1. If a counter is not used in a dashboard, don't collect it. Fine to comment out the counter in its existing template
  2. If none of a template's counters are used, comment out that template in its respective default.yaml
Hardikl commented 10 months ago

I will capture list of counters which are not used in any dashboards, which will help us to take a decision for next steps for this.

Hardikl commented 10 months ago

The list of counters which are not consumed in any dashboards.

For Zapi template:

    dashboard_test.go:1371: These 1 out of 3 counters haven't been used in dashboard from 9.8.0/lun.yaml template [lun_size_used_percent]
    dashboard_test.go:1371: These 2 out of 5 counters haven't been used in dashboard from 9.8.0/namespace.yaml template [namespace_block_size namespace_size_available]
    dashboard_test.go:1371: These 4 out of 13 counters haven't been used in dashboard from 9.8.0/snapmirror.yaml template [snapmirror_total_transfer_time_secs snapmirror_newest_snapshot_timestamp snapmirror_total_transfer_bytes snapmirror_last_transfer_end_timestamp]
    dashboard_test.go:1371: These 1 out of 1 counters haven't been used in dashboard from 9.8.0/security_certificate.yaml template [security_certificate_expiry_time]
    dashboard_test.go:1371: These 1 out of 1 counters haven't been used in dashboard from 9.8.0/netport.yaml template [net_port_mtu]
    dashboard_test.go:1371: These 1 out of 1 counters haven't been used in dashboard from 9.10.0/aggr_object_store_config.yaml template [cloud_target_used]
    dashboard_test.go:1371: These 1 out of 1 counters haven't been used in dashboard from 9.8.0/security_audit_dest.yaml template [security_audit_destination_port]
    dashboard_test.go:1371: These 14 out of 41 counters haven't been used in dashboard from 9.8.0/aggr.yaml template [aggr_space_data_compacted_count aggr_hybrid_cache_size_total aggr_space_sis_shared_count aggr_inode_files_private_used aggr_snapshot_size_total aggr_raid_plex_count aggr_inode_maxfiles_available aggr_space_performance_tier_inactive_user_data aggr_raid_size aggr_inode_maxfiles_used aggr_space_reserved aggr_space_physical_used_percent aggr_space_performance_tier_inactive_user_data_percent aggr_inode_maxfiles_possible]
    dashboard_test.go:1371: These 12 out of 36 counters haven't been used in dashboard from 9.8.0/volume.yaml template [volume_snapshot_reserve_used volume_sis_total_saved_percent volume_space_logical_used_by_snapshots volume_space_expected_available volume_overwrite_reserve_available volume_overwrite_reserve_total volume_filesystem_size volume_autosize_maximum_size volume_autosize_grow_threshold_percent volume_space_logical_used_by_afs volume_overwrite_reserve_used volume_space_logical_available]
    dashboard_test.go:1371: These 3 out of 7 counters haven't been used in dashboard from 9.8.0/disk.yaml template [disk_bytes_per_sector disk_stats_sectors_written disk_stats_sectors_read]
    dashboard_test.go:1371: These 1 out of 4 counters haven't been used in dashboard from 9.8.0/node.yaml template [node_cpu_busytime]

For ZapiPerf template:

    dashboard_test.go:1371: These 12 out of 12 counters haven't been used in dashboard from 9.8.0/token_manager.yaml template [token_token_copy_failure token_token_zero_success token_instance_uuid token_token_copy_success token_token_create_success token_token_zero_bytes token_token_copy_bytes token_token_zero_failure token_node token_token_create_failure token_instance_name token_token_create_bytes]
    dashboard_test.go:1371: These 3 out of 14 counters haven't been used in dashboard from 9.8.0/fcvi.yaml template [fcvi_fcvi fcvi_node fcvi_instance_uuid]
    dashboard_test.go:1371: These 9 out of 11 counters haven't been used in dashboard from 9.8.0/lif.yaml template [lif_instance_name lif_recv_packet lif_recv_errors lif_port lif_instance_uuid lif_svm lif_node lif_sent_errors lif_sent_packet]
    dashboard_test.go:1371: These 10 out of 85 counters haven't been used in dashboard from 9.8.0/nfsv4.yaml template [svm_nfs_renew_total svm_nfs_setclientid_confirm_avg_latency svm_nfs_renew_avg_latency svm_nfs_setclientid_total svm_nfs_open_confirm_total svm_nfs_setclientid_confirm_total svm_nfs_open_confirm_avg_latency svm_nfs_release_lock_owner_avg_latency svm_nfs_setclientid_avg_latency svm_nfs_release_lock_owner_total]
    dashboard_test.go:1371: These 7 out of 8 counters haven't been used in dashboard from 9.8.0/object_store_client_op.yaml template [fabricpool_average_latency fabricpool_instance_uuid fabricpool_get_throughput_bytes fabricpool_node fabricpool_put_throughput_bytes fabricpool_throughput_ops fabricpool_stats]
    dashboard_test.go:1371: These 2 out of 16 counters haven't been used in dashboard from 9.8.0/workload_volume.yaml template [qos_instance_uuid qos_instance_name]
    dashboard_test.go:1371: These 10 out of 17 counters haven't been used in dashboard from 9.8.0/external_service_operation.yaml template [external_service_op_server_ip_address external_service_op_svm external_service_op_instance_uuid external_service_op_operation external_service_op_request_latency_hist external_service_op_node external_service_op_instance_name external_service_op_service_name external_service_op_process_name external_service_op_server_name]
    dashboard_test.go:1371: These 20 out of 23 counters haven't been used in dashboard from 9.8.0/wafl.yaml template [wafl_avg_msg_latency wafl_wafl_reads_from_fc_miss wafl_msg_total wafl_instance_uuid wafl_node wafl_wafl_memory_used wafl_total_cp_msecs wafl_wafl_reads_from_cloud_s2c_bin wafl_wafl_reads_from_pmem wafl_wafl_reads_from_disk wafl_avg_repl_msg_latency wafl_wafl_reads_from_cloud wafl_wafl_reads_from_cache wafl_wafl_repl_msg_total wafl_wafl_memory_free wafl_avg_non_wafl_msg_latency wafl_total_cp_util wafl_wafl_reads_from_ssd wafl_non_wafl_msg_total wafl_wafl_reads_from_ext_cache]
    dashboard_test.go:1371: These 12 out of 29 counters haven't been used in dashboard from 9.8.0/fcp.yaml template [fcp_node fcp_write_ops fcp_instance_uuid fcp_shared_int_count fcp_speed fcp_other_ops fcp_total_data fcp_port fcp_read_ops fcp_reset_count fcp_total_ops fcp_avg_other_latency]
    dashboard_test.go:1371: These 6 out of 7 counters haven't been used in dashboard from 9.8.0/copy_manager.yaml template [copy_manager_instance_uuid copy_manager_ocs_copy_count_curr copy_manager_svm copy_manager_sce_copy_count_curr copy_manager_spince_copy_count_curr copy_manager_bce_copy_count_curr]
    dashboard_test.go:1371: These 2 out of 7 counters haven't been used in dashboard from 9.8.0/vscan_svm.yaml template [svm_vscan_svm svm_vscan_instance_uuid]
    dashboard_test.go:1371: These 2 out of 4 counters haven't been used in dashboard from 9.8.0/hostadapter.yaml template [hostadapter_instance_name hostadapter_node]
    dashboard_test.go:1371: These 3 out of 3 counters haven't been used in dashboard from 9.8.0/wafl_hya_sizer.yaml template [flashpool_instance_name flashpool_cache_stats flashpool_node]
    dashboard_test.go:1371: These 2 out of 36 counters haven't been used in dashboard from 9.8.0/nfsv4_pool.yaml template [nfs_diag_node nfs_diag_instance_uuid]
    dashboard_test.go:1371: These 6 out of 15 counters haven't been used in dashboard from 9.8.0/iscsi_lif.yaml template [iscsi_lif_svm iscsi_lif_instance_uuid iscsi_lif_protocol_errors iscsi_lif_node iscsi_lif_cmd_transfered iscsi_lif_lif]
    dashboard_test.go:1371: These 16 out of 16 counters haven't been used in dashboard from 9.8.0/nvmf_rdma_port.yaml template [nvmf_rdma_port_avg_write_latency nvmf_rdma_port_other_ops nvmf_rdma_port_write_ops nvmf_rdma_port_write_data nvmf_rdma_port_lif nvmf_rdma_port_avg_other_latency nvmf_rdma_port_avg_read_latency nvmf_rdma_port_instance_uuid nvmf_rdma_port_port_ip_addr nvmf_rdma_port_svm nvmf_rdma_port_total_ops nvmf_rdma_port_read_ops nvmf_rdma_port_node nvmf_rdma_port_avg_latency nvmf_rdma_port_total_data nvmf_rdma_port_read_data]
    dashboard_test.go:1371: These 5 out of 11 counters haven't been used in dashboard from 9.8.0/path.yaml template [path_node path_total_iops path_total_data path_instance_name path_instance_uuid]
    dashboard_test.go:1371: These 7 out of 7 counters haven't been used in dashboard from 9.8.0/vscan.yaml template [vscan_scanner_stats_pct_cpu_used vscan_instance_uuid vscan_scan_latency vscan_scanner_stats_pct_mem_used vscan_scan_request_dispatched_rate vscan_instance_name vscan_scanner_stats_pct_network_used]
    dashboard_test.go:1371: These 9 out of 17 counters haven't been used in dashboard from 9.8.0/nic_common.yaml template [nic_speed nic_instance_uuid nic_instance_name nic_rx_errors nic_link_up_to_downs nic_node nic_type nic_state nic_tx_errors]
    dashboard_test.go:1371: These 5 out of 5 counters haven't been used in dashboard from 9.8.0/workload_detail_volume.yaml template [qos_detail_service_time qos_detail_instance_uuid qos_detail_wait_time qos_detail_instance_name qos_detail_visits]
    dashboard_test.go:1371: These 6 out of 12 counters haven't been used in dashboard from 9.10.1/namespace.yaml template [namespace_other_ops namespace_svm namespace_avg_other_latency namespace_path namespace_remote_ops namespace_remote_bytes]
    dashboard_test.go:1371: These 104 out of 113 counters haven't been used in dashboard from 9.8.0/nfsv4_1.yaml template [svm_nfs_close_total svm_nfs_open_total svm_nfs_rename_avg_latency svm_nfs_readdir_avg_latency svm_nfs_exchange_id_avg_latency svm_nfs_access_total svm_nfs_close_avg_latency svm_nfs_layoutget_avg_latency svm_nfs_readlink_avg_latency svm_nfs_commit_avg_latency svm_nfs_putpubfh_total svm_nfs_rename_total svm_nfs_write_latency_hist svm_nfs_open_avg_latency svm_nfs_destroy_session_total svm_nfs_secinfo_no_name_avg_latency svm_nfs_putpubfh_avg_latency svm_nfs_open_downgrade_total svm_nfs_secinfo_total svm_nfs_want_delegation_total svm_nfs_setattr_total svm_nfs_nverify_avg_latency svm_nfs_commit_total svm_nfs_delegpurge_total svm_nfs_lock_avg_latency svm_nfs_lookup_total svm_nfs_setattr_avg_latency svm_nfs_nverify_total svm_nfs_getdevicelist_total svm_nfs_latency_hist svm_nfs_secinfo_no_name_total svm_nfs_locku_total svm_nfs_bind_conn_to_session_total svm_nfs_savefh_avg_latency svm_nfs_layoutget_total svm_nfs_svm svm_nfs_lookup_avg_latency svm_nfs_getfh_avg_latency svm_nfs_lockt_total svm_nfs_null_avg_latency svm_nfs_set_ssv_total svm_nfs_remove_total svm_nfs_getattr_avg_latency svm_nfs_test_stateid_avg_latency svm_nfs_exchange_id_total svm_nfs_getdeviceinfo_avg_latency svm_nfs_openattr_avg_latency svm_nfs_lock_total svm_nfs_create_avg_latency svm_nfs_secinfo_avg_latency svm_nfs_bind_conn_to_session_avg_latency svm_nfs_openattr_total svm_nfs_layoutcommit_total svm_nfs_restorefh_avg_latency svm_nfs_backchannel_ctl_avg_latency svm_nfs_getfh_total svm_nfs_layoutreturn_avg_latency svm_nfs_restorefh_total svm_nfs_lockt_avg_latency svm_nfs_remove_avg_latency svm_nfs_getdevicelist_avg_latency svm_nfs_sequence_avg_latency svm_nfs_putrootfh_total svm_nfs_want_delegation_avg_latency svm_nfs_read_latency_hist svm_nfs_delegpurge_avg_latency svm_nfs_readlink_total svm_nfs_free_stateid_total svm_nfs_locku_avg_latency svm_nfs_putfh_avg_latency svm_nfs_putfh_total svm_nfs_backchannel_ctl_total svm_nfs_link_avg_latency svm_nfs_destroy_clientid_total svm_nfs_link_total svm_nfs_access_avg_latency svm_nfs_get_dir_delegation_avg_latency svm_nfs_putrootfh_avg_latency svm_nfs_layoutreturn_total svm_nfs_getattr_total svm_nfs_readdir_total svm_nfs_verify_avg_latency svm_nfs_lookupp_avg_latency svm_nfs_create_session_total svm_nfs_savefh_total svm_nfs_getdeviceinfo_total svm_nfs_reclaim_complete_total svm_nfs_lookupp_total svm_nfs_reclaim_complete_avg_latency svm_nfs_destroy_session_avg_latency svm_nfs_delegreturn_avg_latency svm_nfs_verify_total svm_nfs_open_downgrade_avg_latency svm_nfs_free_stateid_avg_latency svm_nfs_set_ssv_avg_latency svm_nfs_layoutcommit_avg_latency svm_nfs_create_total svm_nfs_null_total svm_nfs_sequence_total svm_nfs_get_dir_delegation_total svm_nfs_delegreturn_total svm_nfs_create_session_avg_latency svm_nfs_destroy_clientid_avg_latency svm_nfs_test_stateid_total]
    dashboard_test.go:1371: These 7 out of 22 counters haven't been used in dashboard from 9.8.0/lun.yaml template [lun_queue_full lun_svm lun_avg_xcopy_latency lun_instance_name lun_write_partial_blocks lun_read_partial_blocks lun_enospc]
    dashboard_test.go:1371: These 1 out of 11 counters haven't been used in dashboard from 9.8.0/volume_svm.yaml template [svm_vol_svm]
    dashboard_test.go:1371: These 7 out of 13 counters haven't been used in dashboard from 9.8.0/resource_headroom_aggr.yaml template [headroom_aggr_ewma_hourly headroom_aggr_optimal_point_confidence_factor headroom_aggr_ewma_weekly headroom_aggr_ewma_monthly headroom_aggr_node headroom_aggr_ewma_daily headroom_aggr_instance_name]
    dashboard_test.go:1371: These 44 out of 64 counters haven't been used in dashboard from 9.8.0/volume.yaml template [volume_nfs_read_latency volume_instance_uuid node_volume_nfs_read_ops node_volume_instance_uuid node_volume_nfs_punch_hole_ops volume_node node_volume_nfs_access_latency volume_nfs_lookup_latency node_volume_nfs_other_ops node_volume_nfs_other_latency volume_nfs_getattr_ops node_volume_svm node_volume_nfs_setattr_latency volume_nfs_write_ops node_volume_node node_volume_nfs_lookup_latency volume_nfs_access_latency node_volume_nfs_total_ops volume_aggr volume_nfs_other_latency node_volume_nfs_getattr_latency volume_nfs_total_ops volume_instance_name volume_nfs_punch_hole_latency volume_svm volume_nfs_access_ops node_volume_instance_name volume_nfs_punch_hole_ops volume_nfs_read_ops node_volume_nfs_access_ops volume_nfs_setattr_ops node_volume_nfs_setattr_ops node_volume_aggr node_volume_nfs_getattr_ops volume_nfs_getattr_latency node_volume_nfs_lookup_ops node_volume_nfs_punch_hole_latency node_volume_nfs_read_latency node_volume_nfs_write_latency volume_nfs_write_latency node_volume_nfs_write_ops volume_nfs_other_ops volume_nfs_lookup_ops volume_nfs_setattr_latency]
    dashboard_test.go:1371: These 116 out of 175 counters haven't been used in dashboard from 9.8.0/disk.yaml template [raid_disk_user_read_blocks disk_io_queued raid_disk_user_read_chain node_disk_disk_busy raid_disk_instance_uuid node_disk_io_pending aggr_disk_user_write_chain raid_disk_disk_busy disk_disk plex_disk_user_write_chain aggr_disk_user_write_blocks plex_disk_cp_read_latency raid_disk_user_reads aggr_disk_instance_uuid disk_disk_capacity node_disk_disk disk_user_read_latency node_disk_user_write_latency node_disk_total_data plex_disk_io_queued raid_disk_io_queued disk_total_data disk_cp_read_chain disk_user_reads plex_disk_cp_reads node_disk_cp_read_chain raid_disk_cp_read_chain node_disk_total_transfers raid_disk_user_write_blocks disk_user_writes aggr_disk_io_pending plex_disk_instance_uuid node_disk_node node_disk_max_disk node_disk_partition aggr_disk_io_queued node_disk_disk_speed node_disk_user_read_chain plex_disk_partition aggr_disk_disk_capacity disk_node raid_disk_io_pending disk_partition node_disk_cp_read_latency raid_disk_disk_capacity disk_cp_read_latency node_disk_user_read_blocks node_disk_user_reads aggr_disk_max_disk disk_io_pending plex_disk_user_write_blocks node_disk_raid_type plex_disk_io_pending raid_disk_user_writes plex_disk_user_read_chain disk_disk_speed aggr_disk_raid_type plex_disk_disk_busy aggr_disk_disk node_disk_user_read_latency aggr_disk_cp_read_chain disk_disk_busy node_disk_cp_reads disk_user_read_blocks raid_disk_raid_group aggr_disk_partition plex_disk_node disk_raid_type node_disk_instance_uuid disk_user_write_chain aggr_disk_cp_read_latency aggr_disk_node raid_disk_disk_speed disk_user_write_blocks aggr_disk_user_read_blocks node_disk_user_write_chain raid_disk_raid_type raid_disk_disk aggr_disk_user_write_latency aggr_disk_raid_group raid_disk_node plex_disk_disk_capacity disk_user_write_latency node_disk_user_writes plex_disk_raid_type node_disk_disk_capacity plex_disk_disk node_disk_raid_group disk_total_transfers disk_disk_uuid plex_disk_raid_group plex_disk_total_transfers aggr_disk_disk_busy plex_disk_user_read_blocks aggr_disk_disk_speed plex_disk_cp_read_chain raid_disk_disk_uuid raid_disk_total_data disk_cp_reads node_disk_user_write_blocks plex_disk_total_data aggr_disk_cp_reads aggr_disk_user_read_chain disk_user_read_chain aggr_disk_disk_uuid raid_disk_cp_reads node_disk_disk_uuid raid_disk_user_write_chain plex_disk_disk_speed raid_disk_cp_read_latency aggr_disk_user_read_latency disk_raid_group plex_disk_disk_uuid raid_disk_partition disk_instance_uuid node_disk_io_queued]
    dashboard_test.go:1371: These 5 out of 15 counters haven't been used in dashboard from 9.10.1/nvmf_lif.yaml template [nvme_lif_svm nvme_lif_port nvme_lif_lif nvme_lif_instance_uuid nvme_lif_node]
    dashboard_test.go:1371: These 18 out of 52 counters haven't been used in dashboard from 9.8.0/nfsv3_node.yaml template [node_nfs_pathconf_avg_latency node_nfs_symlink_total node_nfs_readdirplus_total node_nfs_fsstat_total node_nfs_mkdir_total node_nfs_pathconf_total node_nfs_mkdir_avg_latency node_nfs_fsinfo_total node_nfs_fsstat_avg_latency node_nfs_read_symlink_avg_latency node_nfs_mknod_avg_latency node_nfs_read_symlink_total node_nfs_mknod_total node_nfs_symlink_avg_latency node_nfs_rmdir_total node_nfs_readdirplus_avg_latency node_nfs_fsinfo_avg_latency node_nfs_rmdir_avg_latency]
    dashboard_test.go:1371: These 18 out of 20 counters haven't been used in dashboard from 9.8.0/ext_cache_obj.yaml template [flashcache_miss_metadata_file flashcache_node flashcache_hit flashcache_invalidates flashcache_miss_directory flashcache_hit_directory flashcache_evicts flashcache_hit_indirect flashcache_instance_uuid flashcache_usage flashcache_inserts flashcache_instance_name flashcache_accesses flashcache_miss_normal_lev0 flashcache_miss_indirect flashcache_miss flashcache_hit_normal_lev0 flashcache_hit_metadata_file]
    dashboard_test.go:1371: These 11 out of 35 counters haven't been used in dashboard from 9.8.0/smb2.yaml template [smb2_create_latency_histogram smb2_session_setup_latency_histogram smb2_set_info_latency_histogram smb2_lock_latency_histogram smb2_node smb2_svm smb2_query_directory_latency_histogram smb2_instance_uuid smb2_oplock_break_latency_histogram smb2_close_latency_histogram smb2_query_info_latency_histogram]
    dashboard_test.go:1371: These 3 out of 7 counters haven't been used in dashboard from 9.8.0/iwarp.yaml template [iw_instance_uuid iw_adapter iw_node]
    dashboard_test.go:1371: These 4 out of 6 counters haven't been used in dashboard from 9.8.0/wafl_comp_aggr_vol_bin.yaml template [fabricpool_volume fabricpool_instance_name fabricpool_cloud_target fabricpool_svm]
    dashboard_test.go:1371: These 5 out of 15 counters haven't been used in dashboard from 9.8.0/fcp_lif.yaml template [fcp_lif_lif fcp_lif_instance_uuid fcp_lif_node fcp_lif_svm fcp_lif_port]
    dashboard_test.go:1371: These 6 out of 11 counters haven't been used in dashboard from 9.8.0/cifs_node.yaml template [node_cifs_read_latency node_cifs_write_ops node_cifs_node node_cifs_write_latency node_cifs_read_ops node_cifs_total_ops]
    dashboard_test.go:1371: These 75 out of 82 counters haven't been used in dashboard from 9.8.0/nfsv4_node.yaml template [node_nfs_open_avg_latency node_nfs_readdir_avg_latency node_nfs_setattr_total node_nfs_readlink_avg_latency node_nfs_close_total node_nfs_readlink_total node_nfs_lock_avg_latency node_nfs_delegreturn_total node_nfs_setclientid_confirm_total node_nfs_renew_avg_latency node_nfs_getfh_total node_nfs_link_avg_latency node_nfs_node node_nfs_lockt_avg_latency node_nfs_close_avg_latency node_nfs_openattr_avg_latency node_nfs_remove_avg_latency node_nfs_putfh_avg_latency node_nfs_setclientid_avg_latency node_nfs_nverify_avg_latency node_nfs_open_downgrade_avg_latency node_nfs_rename_avg_latency node_nfs_readdir_total node_nfs_lock_total node_nfs_null_avg_latency node_nfs_openattr_total node_nfs_delegreturn_avg_latency node_nfs_open_downgrade_total node_nfs_write_total node_nfs_release_lock_owner_avg_latency node_nfs_secinfo_total node_nfs_lookupp_total node_nfs_getattr_avg_latency node_nfs_restorefh_avg_latency node_nfs_lockt_total node_nfs_lookup_avg_latency node_nfs_locku_total node_nfs_create_avg_latency node_nfs_link_total node_nfs_lookup_total node_nfs_lookupp_avg_latency node_nfs_verify_total node_nfs_delegpurge_avg_latency node_nfs_delegpurge_total node_nfs_access_avg_latency node_nfs_remove_total node_nfs_secinfo_avg_latency node_nfs_restorefh_total node_nfs_putfh_total node_nfs_commit_total node_nfs_putpubfh_avg_latency node_nfs_access_total node_nfs_create_total node_nfs_open_confirm_avg_latency node_nfs_release_lock_owner_total node_nfs_putrootfh_avg_latency node_nfs_getfh_avg_latency node_nfs_null_total node_nfs_savefh_avg_latency node_nfs_renew_total node_nfs_putpubfh_total node_nfs_read_total node_nfs_open_confirm_total node_nfs_savefh_total node_nfs_verify_avg_latency node_nfs_rename_total node_nfs_locku_avg_latency node_nfs_setattr_avg_latency node_nfs_setclientid_total node_nfs_commit_avg_latency node_nfs_getattr_total node_nfs_setclientid_confirm_avg_latency node_nfs_nverify_total node_nfs_putrootfh_total node_nfs_open_total]
    dashboard_test.go:1371: These 34 out of 35 counters haven't been used in dashboard from 9.8.0/volume_node.yaml template [node_vol_iscsi_write_data node_vol_fcp_write_latency node_vol_read_latency node_vol_fcp_read_latency node_vol_cifs_read_data node_vol_cifs_write_data node_vol_fcp_other_ops node_vol_nfs_other_latency node_vol_node node_vol_cifs_read_latency node_vol_nfs_read_latency node_vol_cifs_other_ops node_vol_fcp_read_ops node_vol_iscsi_read_data node_vol_iscsi_other_latency node_vol_iscsi_read_ops node_vol_nfs_write_data node_vol_nfs_read_ops node_vol_nfs_write_ops node_vol_fcp_read_data node_vol_cifs_read_ops node_vol_fcp_write_ops node_vol_cifs_write_latency node_vol_iscsi_write_ops node_vol_fcp_write_data node_vol_nfs_read_data node_vol_nfs_write_latency node_vol_iscsi_other_ops node_vol_cifs_other_latency node_vol_nfs_other_ops node_vol_iscsi_read_latency node_vol_cifs_write_ops node_vol_fcp_other_latency node_vol_iscsi_write_latency]
    dashboard_test.go:1371: These 18 out of 55 counters haven't been used in dashboard from 9.10.1/fcp.yaml template [fcp_nvmf_remote_read_data fcp_nvmf_command_slots fcp_nvmf_remote_other_ops fcp_nvmf_caw_ops fcp_link_up fcp_nvmf_avg_other_latency fcp_nvmf_remote_caw_ops fcp_nvmf_avg_remote_write_latency fcp_nvmf_remote_write_data fcp_nvmf_other_ops fcp_nvmf_avg_remote_read_latency fcp_nvmf_remote_total_ops fcp_nvmf_caw_data fcp_nvmf_remote_read_ops fcp_nvmf_remote_total_data fcp_nvmf_remote_caw_data fcp_nvmf_remote_write_ops fcp_nvmf_avg_remote_other_latency]
    dashboard_test.go:1371: These 18 out of 55 counters haven't been used in dashboard from 9.8.0/nfsv3.yaml template [svm_nfs_rmdir_total svm_nfs_readdirplus_avg_latency svm_nfs_fsstat_avg_latency svm_nfs_rmdir_avg_latency svm_nfs_mkdir_avg_latency svm_nfs_mknod_total svm_nfs_read_symlink_avg_latency svm_nfs_symlink_avg_latency svm_nfs_pathconf_total svm_nfs_mknod_avg_latency svm_nfs_fsinfo_total svm_nfs_pathconf_avg_latency svm_nfs_symlink_total svm_nfs_fsinfo_avg_latency svm_nfs_read_symlink_total svm_nfs_readdirplus_total svm_nfs_fsstat_total svm_nfs_mkdir_total]
    dashboard_test.go:1371: These 14 out of 14 counters haven't been used in dashboard from 9.8.0/netstat.yaml template [netstat_laddr netstat_fport netstat_cong_win_th netstat_send_window netstat_ooorcv_pkts netstat_node netstat_cong_win netstat_recv_window netstat_bytes_sent netstat_instance_uuid netstat_bytes_recvd netstat_faddr netstat_rexmit_pkts netstat_lport]
    dashboard_test.go:1371: These 130 out of 130 counters haven't been used in dashboard from 9.8.0/ontap_s3_svm.yaml template [ontaps3_svm_list_buckets_failed ontaps3_svm_abort_multipart_upload_rate ontaps3_svm_get_object_tagging_failed ontaps3_svm_list_uploads_failed_client_close ontaps3_svm_input_flow_control_entry ontaps3_svm_create_bucket_total ontaps3_svm_head_bucket_rate ontaps3_svm_put_object_rate ontaps3_svm_delete_object_failed ontaps3_svm_allow_access ontaps3_svm_initiate_multipart_upload_latency ontaps3_svm_head_bucket_total ontaps3_svm_delete_object_latency ontaps3_svm_head_object_failed ontaps3_svm_put_data ontaps3_svm_authentication_failures ontaps3_svm_abort_multipart_upload_total ontaps3_svm_put_bucket_versioning_failed ontaps3_svm_get_object_lastbyte_latency ontaps3_svm_create_bucket_rate ontaps3_svm_output_flow_control_exit ontaps3_svm_delete_object_total ontaps3_svm_list_object_versions_rate ontaps3_svm_list_buckets_rate ontaps3_svm_list_object_versions_failed_client_close ontaps3_svm_output_flow_control_entry ontaps3_svm_request_parse_errors ontaps3_svm_list_uploads_failed ontaps3_svm_max_cmds_per_connection ontaps3_svm_requests ontaps3_svm_list_object_versions_latency ontaps3_svm_upload_part_total ontaps3_svm_list_buckets_latency ontaps3_svm_abort_multipart_upload_failed_client_close ontaps3_svm_chunked_upload_reqs ontaps3_svm_signature_v4_reqs ontaps3_svm_delete_bucket_failed ontaps3_svm_get_bucket_versioning_failed ontaps3_svm_put_object_tagging_latency ontaps3_svm_put_object_latency ontaps3_svm_list_objects_total ontaps3_svm_head_bucket_latency ontaps3_svm_put_object_tagging_failed_client_close ontaps3_svm_head_object_latency ontaps3_svm_create_bucket_latency ontaps3_svm_group_policy_evaluated ontaps3_svm_put_object_failed_client_close ontaps3_svm_multi_delete_reqs ontaps3_svm_get_object_tagging_rate ontaps3_svm_head_bucket_failed_client_close ontaps3_svm_get_object_failed ontaps3_svm_signature_v2_reqs ontaps3_svm_tagging ontaps3_svm_delete_object_rate ontaps3_svm_max_requests_outstanding ontaps3_svm_put_bucket_versioning_total ontaps3_svm_explicit_deny_access ontaps3_svm_delete_bucket_latency ontaps3_svm_abort_multipart_upload_failed ontaps3_svm_server_connection_close ontaps3_svm_get_bucket_versioning_total ontaps3_svm_complete_multipart_upload_rate ontaps3_svm_default_deny_access ontaps3_svm_list_object_versions_failed ontaps3_svm_delete_bucket_failed_client_close ontaps3_svm_get_object_acl_total ontaps3_svm_put_object_tagging_total ontaps3_svm_delete_object_tagging_latency ontaps3_svm_put_object_total ontaps3_svm_delete_object_tagging_total ontaps3_svm_svm ontaps3_svm_delete_object_tagging_rate ontaps3_svm_get_object_failed_client_close ontaps3_svm_list_objects_rate ontaps3_svm_upload_part_latency ontaps3_svm_get_data ontaps3_svm_get_object_tagging_total ontaps3_svm_anonymous_deny_access ontaps3_svm_complete_multipart_upload_latency ontaps3_svm_delete_bucket_total ontaps3_svm_connected_connections ontaps3_svm_delete_object_tagging_failed_client_close ontaps3_svm_head_object_rate ontaps3_svm_initiate_multipart_upload_total ontaps3_svm_list_uploads_total ontaps3_svm_put_object_tagging_failed ontaps3_svm_input_flow_control_exit ontaps3_svm_put_object_failed ontaps3_svm_initiate_multipart_upload_failed ontaps3_svm_complete_multipart_upload_failed ontaps3_svm_initiate_multipart_upload_rate ontaps3_svm_delete_bucket_rate ontaps3_svm_complete_multipart_upload_failed_client_close ontaps3_svm_delete_object_tagging_failed ontaps3_svm_get_object_latency ontaps3_svm_node ontaps3_svm_upload_part_rate ontaps3_svm_list_buckets_failed_client_close ontaps3_svm_list_objects_failed_client_close ontaps3_svm_delete_object_failed_client_close ontaps3_svm_list_objects_failed ontaps3_svm_anonymous_access ontaps3_svm_get_object_acl_failed ontaps3_svm_connections ontaps3_svm_list_uploads_latency ontaps3_svm_head_object_total ontaps3_svm_get_object_total ontaps3_svm_presigned_url_reqs ontaps3_svm_get_object_rate ontaps3_svm_head_object_failed_client_close ontaps3_svm_upload_part_failed_client_close ontaps3_svm_get_bucket_acl_total ontaps3_svm_put_object_tagging_rate ontaps3_svm_list_buckets_total ontaps3_svm_initiate_multipart_upload_failed_client_close ontaps3_svm_head_bucket_failed ontaps3_svm_list_object_versions_total ontaps3_svm_list_uploads_rate ontaps3_svm_complete_multipart_upload_total ontaps3_svm_create_bucket_failed_client_close ontaps3_svm_create_bucket_failed ontaps3_svm_get_bucket_acl_failed ontaps3_svm_upload_part_failed ontaps3_svm_list_objects_latency ontaps3_svm_max_connected_connections ontaps3_svm_root_user_access ontaps3_svm_get_object_tagging_failed_client_close ontaps3_svm_get_object_tagging_latency ontaps3_svm_abort_multipart_upload_latency ontaps3_svm_requests_outstanding]
    dashboard_test.go:1371: These 16 out of 16 counters haven't been used in dashboard from 9.8.0/nvmf_tcp_port.yaml template [nvmf_tcp_port_avg_read_latency nvmf_tcp_port_read_ops nvmf_tcp_port_write_data nvmf_tcp_port_svm nvmf_tcp_port_node nvmf_tcp_port_avg_write_latency nvmf_tcp_port_total_data nvmf_tcp_port_avg_latency nvmf_tcp_port_lif nvmf_tcp_port_port_ip_addr nvmf_tcp_port_other_ops nvmf_tcp_port_write_ops nvmf_tcp_port_read_data nvmf_tcp_port_avg_other_latency nvmf_tcp_port_instance_uuid nvmf_tcp_port_total_ops]
    dashboard_test.go:1371: These 15 out of 26 counters haven't been used in dashboard from 9.8.0/system_node.yaml template [node_hdd_data_written node_total_latency node_instance_name node_total_data node_cpu_elapsed_time node_net_data_sent node_ssd_data_read node_ssd_data_written node_fcp_data_sent node_nvmf_data_recv node_hdd_data_read node_fcp_data_recv node_nvmf_data_sent node_net_data_recv node_memory]
    dashboard_test.go:1371: These 38 out of 110 counters haven't been used in dashboard from 9.8.0/nfsv4_1_node.yaml template [node_nfs_set_ssv_avg_latency node_nfs_getdeviceinfo_total node_nfs_layoutreturn_avg_latency node_nfs_create_session_avg_latency node_nfs_destroy_clientid_total node_nfs_bind_conn_to_session_avg_latency node_nfs_layoutcommit_avg_latency node_nfs_reclaim_complete_avg_latency node_nfs_test_stateid_avg_latency node_nfs_exchange_id_avg_latency node_nfs_getdeviceinfo_avg_latency node_nfs_secinfo_no_name_total node_nfs_get_dir_delegation_avg_latency node_nfs_free_stateid_avg_latency node_nfs_want_delegation_total node_nfs_exchange_id_total node_nfs_layoutget_avg_latency node_nfs_set_ssv_total node_nfs_secinfo_no_name_avg_latency node_nfs_backchannel_ctl_avg_latency node_nfs_bind_conn_to_session_total node_nfs_reclaim_complete_total node_nfs_layoutcommit_total node_nfs_layoutreturn_total node_nfs_getdevicelist_avg_latency node_nfs_backchannel_ctl_total node_nfs_sequence_total node_nfs_free_stateid_total node_nfs_want_delegation_avg_latency node_nfs_destroy_clientid_avg_latency node_nfs_test_stateid_total node_nfs_destroy_session_total node_nfs_get_dir_delegation_total node_nfs_layoutget_total node_nfs_create_session_total node_nfs_getdevicelist_total node_nfs_sequence_avg_latency node_nfs_destroy_session_avg_latency]
    dashboard_test.go:1371: These 5 out of 13 counters haven't been used in dashboard from 9.8.0/cifs_vserver.yaml template [svm_cifs_ops svm_cifs_established_sessions svm_cifs_svm svm_cifs_signed_sessions svm_cifs_instance_uuid]
    dashboard_test.go:1371: These 7 out of 20 counters haven't been used in dashboard from 9.8.0/wafl_hya_per_aggr.yaml template [flashpool_aggr flashpool_hya_write_hdd_latency_average flashpool_write_blks_replaced flashpool_ssd_available flashpool_write_blks_replaced_percent flashpool_hya_write_ssd_latency_average flashpool_ssd_total_used]
    dashboard_test.go:1371: These 7 out of 13 counters haven't been used in dashboard from 9.8.0/resource_headroom_cpu.yaml template [headroom_cpu_optimal_point_confidence_factor headroom_cpu_ewma_monthly headroom_cpu_ewma_daily headroom_cpu_instance_name headroom_cpu_ewma_hourly headroom_cpu_node headroom_cpu_ewma_weekly]
    dashboard_test.go:1371: These 5 out of 9 counters haven't been used in dashboard from 9.8.0/qtree.yaml template [qtree_node qtree_volume qtree_svm qtree_instance_uuid qtree_qtreefull]

For Rest template:

    dashboard_test.go:1374: These 18 out of 52 counters haven't been used in dashboard from 9.12.0/aggr.yaml template [aggr_inode_maxfiles_used aggr_space_physical_used_percent aggr_space_performance_tier_inactive_user_data_percent aggr_space_sis_shared_count aggr_hybrid_cache_size_total aggr_primary_disk_count aggr_inode_files_private_used aggr_raid_size aggr_raid_plex_count aggr_inode_maxfiles_possible aggr_hybrid_disk_count aggr_space_performance_tier_inactive_user_data aggr_snapshot_size_total aggr_space_data_compacted_count aggr_efficiency_savings aggr_efficiency_savings_wo_snapshots_flexclones aggr_efficiency_savings_wo_snapshots aggr_inode_maxfiles_available]
    dashboard_test.go:1374: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/netport.yaml template [net_port_mtu]
    dashboard_test.go:1374: These 11 out of 35 counters haven't been used in dashboard from 9.12.0/volume.yaml template [volume_overwrite_reserve_available volume_space_expected_available volume_space_logical_used_by_snapshots volume_overwrite_reserve_total volume_snapshot_reserve_used volume_autosize_grow_threshold_percent volume_overwrite_reserve_used volume_autosize_maximum_size volume_sis_total_saved_percent volume_space_logical_used_by_afs volume_filesystem_size]
    dashboard_test.go:1374: These 2 out of 5 counters haven't been used in dashboard from 9.12.0/namespace.yaml template [namespace_block_size namespace_size_available]
    dashboard_test.go:1374: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/security_certificate.yaml template [security_certificate_expiry_time]
    dashboard_test.go:1374: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/cloud_target.yaml template [cloud_target_used]
    dashboard_test.go:1374: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/security_ssh.yaml template [security_ssh_max_instances]
    dashboard_test.go:1374: These 3 out of 6 counters haven't been used in dashboard from 9.12.0/disk.yaml template [disk_usable_size disk_bytes_per_sector disk_power_on_hours]
    dashboard_test.go:1374: These 1 out of 3 counters haven't been used in dashboard from 9.12.0/lun.yaml template [lun_size_used_percent]
    dashboard_test.go:1374: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/qtree.yaml template [qtree_id]
    dashboard_test.go:1374: These 4 out of 13 counters haven't been used in dashboard from 9.12.0/snapmirror.yaml template [snapmirror_total_transfer_bytes snapmirror_total_transfer_time_secs snapmirror_newest_snapshot_timestamp snapmirror_last_transfer_end_timestamp]

For RestPerf template:

    dashboard_test.go:1371: These 2 out of 11 counters haven't been used in dashboard from 9.12.0/iscsi_lif.yaml template [iscsi_lif_protocol_errors iscsi_lif_cmd_transferred]
    dashboard_test.go:1371: These 18 out of 54 counters haven't been used in dashboard from 9.12.0/nfsv3.yaml template [svm_nfs_fsinfo_avg_latency svm_nfs_fsinfo_total svm_nfs_read_symlink_total svm_nfs_fsstat_total svm_nfs_symlink_total svm_nfs_rmdir_total svm_nfs_mkdir_avg_latency svm_nfs_read_symlink_avg_latency svm_nfs_mkdir_total svm_nfs_symlink_avg_latency svm_nfs_mknod_avg_latency svm_nfs_rmdir_avg_latency svm_nfs_readdirplus_avg_latency svm_nfs_mknod_total svm_nfs_readdirplus_total svm_nfs_fsstat_avg_latency svm_nfs_pathconf_total svm_nfs_pathconf_avg_latency]
    dashboard_test.go:1371: These 17 out of 20 counters haven't been used in dashboard from 9.12.0/wafl.yaml template [wafl_reads_from_disk wafl_reads_from_cache wafl_reads_from_ssd wafl_avg_non_wafl_msg_latency wafl_non_wafl_msg_total wafl_reads_from_fc_miss wafl_reads_from_ext_cache wafl_memory_free wafl_reads_from_cloud_s2c_bin wafl_total_cp_util wafl_memory_used wafl_msg_total wafl_avg_repl_msg_latency wafl_repl_msg_total wafl_reads_from_cloud wafl_total_cp_msecs wafl_avg_msg_latency]
    dashboard_test.go:1371: These 5 out of 11 counters haven't been used in dashboard from 9.12.0/resource_headroom_cpu.yaml template [headroom_cpu_ewma_monthly headroom_cpu_ewma_daily headroom_cpu_ewma_weekly headroom_cpu_optimal_point_confidence_factor headroom_cpu_ewma_hourly]
    dashboard_test.go:1371: These 3 out of 11 counters haven't been used in dashboard from 9.12.0/nic_common.yaml template [nic_link_up_to_downs nic_tx_errors nic_rx_errors]
    dashboard_test.go:1371: These 1 out of 1 counters haven't been used in dashboard from 9.12.0/wafl_hya_sizer.yaml template [flashpool_cache_stats]
    dashboard_test.go:1371: These 100 out of 109 counters haven't been used in dashboard from 9.12.0/nfsv4_2.yaml template [svm_nfs_lock_avg_latency svm_nfs_commit_total svm_nfs_set_ssv_total svm_nfs_rename_total svm_nfs_setattr_total svm_nfs_remove_avg_latency svm_nfs_secinfo_no_name_avg_latency svm_nfs_putpubfh_total svm_nfs_getfh_avg_latency svm_nfs_commit_avg_latency svm_nfs_sequence_avg_latency svm_nfs_create_session_total svm_nfs_create_avg_latency svm_nfs_readlink_total svm_nfs_layoutcommit_avg_latency svm_nfs_lock_total svm_nfs_bind_conn_to_session_avg_latency svm_nfs_delegreturn_avg_latency svm_nfs_lockt_avg_latency svm_nfs_null_avg_latency svm_nfs_destroy_session_avg_latency svm_nfs_getattr_avg_latency svm_nfs_layoutget_total svm_nfs_readdir_avg_latency svm_nfs_locku_avg_latency svm_nfs_savefh_total svm_nfs_verify_avg_latency svm_nfs_want_delegation_total svm_nfs_lookup_avg_latency svm_nfs_getdevicelist_avg_latency svm_nfs_delegreturn_total svm_nfs_get_dir_delegation_avg_latency svm_nfs_putpubfh_avg_latency svm_nfs_layoutcommit_total svm_nfs_free_stateid_total svm_nfs_readlink_avg_latency svm_nfs_setattr_avg_latency svm_nfs_getfh_total svm_nfs_exchange_id_total svm_nfs_open_avg_latency svm_nfs_link_total svm_nfs_getdeviceinfo_avg_latency svm_nfs_close_avg_latency svm_nfs_free_stateid_avg_latency svm_nfs_savefh_avg_latency svm_nfs_open_total svm_nfs_delegpurge_avg_latency svm_nfs_destroy_session_total svm_nfs_destroy_clientid_avg_latency svm_nfs_reclaim_complete_total svm_nfs_open_downgrade_total svm_nfs_test_stateid_avg_latency svm_nfs_secinfo_no_name_total svm_nfs_get_dir_delegation_total svm_nfs_reclaim_complete_avg_latency svm_nfs_putrootfh_avg_latency svm_nfs_destroy_clientid_total svm_nfs_layoutget_avg_latency svm_nfs_layoutreturn_avg_latency svm_nfs_backchannel_ctl_total svm_nfs_putfh_avg_latency svm_nfs_restorefh_total svm_nfs_layoutreturn_total svm_nfs_test_stateid_total svm_nfs_putfh_total svm_nfs_open_downgrade_avg_latency svm_nfs_want_delegation_avg_latency svm_nfs_lookup_total svm_nfs_sequence_total svm_nfs_link_avg_latency svm_nfs_lookupp_total svm_nfs_restorefh_avg_latency svm_nfs_set_ssv_avg_latency svm_nfs_nverify_total svm_nfs_locku_total svm_nfs_verify_total svm_nfs_access_total svm_nfs_readdir_total svm_nfs_openattr_avg_latency svm_nfs_access_avg_latency svm_nfs_getattr_total svm_nfs_exchange_id_avg_latency svm_nfs_getdeviceinfo_total svm_nfs_secinfo_avg_latency svm_nfs_lockt_total svm_nfs_backchannel_ctl_avg_latency svm_nfs_putrootfh_total svm_nfs_remove_total svm_nfs_openattr_total svm_nfs_nverify_avg_latency svm_nfs_close_total svm_nfs_rename_avg_latency svm_nfs_bind_conn_to_session_total svm_nfs_secinfo_total svm_nfs_lookupp_avg_latency svm_nfs_null_total svm_nfs_create_session_avg_latency svm_nfs_create_total svm_nfs_getdevicelist_total svm_nfs_delegpurge_total]
    dashboard_test.go:1371: These 74 out of 81 counters haven't been used in dashboard from 9.12.0/nfsv4_node.yaml template [node_nfs_setattr_avg_latency node_nfs_release_lock_owner_avg_latency node_nfs_putfh_total node_nfs_openattr_avg_latency node_nfs_readdir_total node_nfs_delegreturn_total node_nfs_lockt_avg_latency node_nfs_locku_total node_nfs_lookup_total node_nfs_close_total node_nfs_getfh_total node_nfs_remove_avg_latency node_nfs_getattr_total node_nfs_openattr_total node_nfs_savefh_avg_latency node_nfs_delegreturn_avg_latency node_nfs_open_confirm_avg_latency node_nfs_create_avg_latency node_nfs_setclientid_avg_latency node_nfs_read_total node_nfs_renew_total node_nfs_lookupp_total node_nfs_setclientid_total node_nfs_setattr_total node_nfs_verify_avg_latency node_nfs_link_total node_nfs_commit_avg_latency node_nfs_putpubfh_total node_nfs_lookup_avg_latency node_nfs_write_total node_nfs_putrootfh_total node_nfs_commit_total node_nfs_lock_total node_nfs_open_confirm_total node_nfs_getfh_avg_latency node_nfs_open_avg_latency node_nfs_readlink_avg_latency node_nfs_link_avg_latency node_nfs_close_avg_latency node_nfs_delegpurge_avg_latency node_nfs_release_lock_owner_total node_nfs_open_total node_nfs_lookupp_avg_latency node_nfs_locku_avg_latency node_nfs_verify_total node_nfs_lockt_total node_nfs_remove_total node_nfs_putpubfh_avg_latency node_nfs_setclientid_confirm_avg_latency node_nfs_open_downgrade_avg_latency node_nfs_rename_total node_nfs_create_total node_nfs_getattr_avg_latency node_nfs_null_avg_latency node_nfs_open_downgrade_total node_nfs_secinfo_total node_nfs_putrootfh_avg_latency node_nfs_nverify_total node_nfs_restorefh_total node_nfs_delegpurge_total node_nfs_readdir_avg_latency node_nfs_putfh_avg_latency node_nfs_savefh_total node_nfs_secinfo_avg_latency node_nfs_setclientid_confirm_total node_nfs_access_avg_latency node_nfs_rename_avg_latency node_nfs_nverify_avg_latency node_nfs_null_total node_nfs_lock_avg_latency node_nfs_restorefh_avg_latency node_nfs_access_total node_nfs_readlink_total node_nfs_renew_avg_latency]
    dashboard_test.go:1371: These 26 out of 51 counters haven't been used in dashboard from 9.12.0/fcp.yaml template [fcp_nvmf_remote_other_ops fcp_nvmf_caw_ops fcp_reset_count fcp_nvmf_remote_caw_data fcp_nvmf_remote_write_ops fcp_avg_other_latency fcp_nvmf_caw_data fcp_nvmf_avg_remote_other_latency fcp_shared_int_count fcp_total_ops fcp_nvmf_avg_remote_read_latency fcp_write_ops fcp_nvmf_avg_remote_write_latency fcp_nvmf_remote_caw_ops fcp_nvmf_remote_read_data fcp_nvmf_avg_other_latency fcp_link_up fcp_nvmf_other_ops fcp_total_data fcp_nvmf_remote_total_ops fcp_nvmf_remote_total_data fcp_read_ops fcp_nvmf_command_slots fcp_nvmf_remote_write_data fcp_other_ops fcp_nvmf_remote_read_ops]
    dashboard_test.go:1371: These 5 out of 10 counters haven't been used in dashboard from 9.12.0/cifs_node.yaml template [node_cifs_read_latency node_cifs_write_ops node_cifs_write_latency node_cifs_read_ops node_cifs_total_ops]
    dashboard_test.go:1371: These 99 out of 119 counters haven't been used in dashboard from 9.12.0/disk.yaml template [aggr_disk_max_user_read_latency disk_user_read_blocks disk_total_transfers node_disk_total_data disk_user_read_chain plex_disk_cp_reads raid_disk_capacity plex_disk_capacity node_disk_max_user_write_blocks aggr_disk_max_total_data node_disk_user_write_chain aggr_disk_user_read_latency disk_io_queued disk_user_writes raid_disk_user_write_blocks node_disk_capacity node_disk_max_user_write_chain node_disk_user_read_latency node_disk_max_io_pending raid_disk_user_reads aggr_disk_user_write_blocks aggr_disk_max_user_write_blocks aggr_disk_max_io_queued plex_disk_total_transfers node_disk_io_queued node_disk_max_user_read_latency node_disk_cp_read_chain node_disk_max_capacity raid_disk_user_read_chain disk_cp_read_chain disk_busy plex_disk_cp_read_latency node_disk_user_read_chain disk_user_reads raid_disk_cp_read_latency aggr_disk_user_read_blocks aggr_disk_cp_read_chain disk_user_write_chain disk_cp_reads node_disk_cp_reads raid_disk_user_write_chain aggr_disk_io_queued aggr_disk_max_capacity aggr_disk_io_pending node_disk_max_cp_read_latency raid_disk_cp_reads node_disk_max_user_reads node_disk_cp_read_latency node_disk_total_transfers node_disk_user_writes aggr_disk_user_write_latency plex_disk_user_write_chain disk_capacity aggr_disk_user_read_chain disk_total_data raid_disk_cp_read_chain node_disk_max_io_queued node_disk_user_write_latency raid_disk_user_writes aggr_disk_max_cp_reads aggr_disk_max_user_write_latency node_disk_max_total_transfers aggr_disk_max_user_read_blocks raid_disk_total_data plex_disk_user_read_chain node_disk_user_write_blocks node_disk_max_user_read_blocks node_disk_max_user_writes aggr_disk_capacity disk_io_pending aggr_disk_cp_reads node_disk_max_user_write_latency aggr_disk_max_cp_read_latency node_disk_max_cp_read_chain plex_disk_cp_read_chain node_disk_user_reads raid_disk_user_read_blocks node_disk_max_total_data node_disk_user_read_blocks aggr_disk_cp_read_latency node_disk_max_user_read_chain plex_disk_user_write_blocks aggr_disk_max_io_pending plex_disk_io_queued node_disk_max_cp_reads node_disk_io_pending aggr_disk_user_write_chain raid_disk_io_queued plex_disk_total_data disk_user_write_latency plex_disk_io_pending raid_disk_io_pending aggr_disk_max_cp_read_chain disk_user_write_blocks disk_user_read_latency aggr_disk_max_user_reads plex_disk_user_read_blocks disk_cp_read_latency aggr_disk_max_user_writes]
    dashboard_test.go:1371: These 38 out of 109 counters haven't been used in dashboard from 9.12.0/nfsv4_2_node.yaml template [node_nfs_layoutget_total node_nfs_reclaim_complete_avg_latency node_nfs_getdevicelist_avg_latency node_nfs_create_session_total node_nfs_get_dir_delegation_avg_latency node_nfs_backchannel_ctl_total node_nfs_sequence_total node_nfs_sequence_avg_latency node_nfs_set_ssv_total node_nfs_exchange_id_avg_latency node_nfs_getdeviceinfo_avg_latency node_nfs_secinfo_no_name_total node_nfs_destroy_session_avg_latency node_nfs_free_stateid_total node_nfs_layoutcommit_total node_nfs_reclaim_complete_total node_nfs_backchannel_ctl_avg_latency node_nfs_create_session_avg_latency node_nfs_bind_conn_to_session_avg_latency node_nfs_layoutreturn_avg_latency node_nfs_test_stateid_avg_latency node_nfs_want_delegation_total node_nfs_destroy_session_total node_nfs_layoutcommit_avg_latency node_nfs_layoutget_avg_latency node_nfs_getdeviceinfo_total node_nfs_secinfo_no_name_avg_latency node_nfs_destroy_clientid_total node_nfs_exchange_id_total node_nfs_want_delegation_avg_latency node_nfs_set_ssv_avg_latency node_nfs_getdevicelist_total node_nfs_layoutreturn_total node_nfs_test_stateid_total node_nfs_bind_conn_to_session_total node_nfs_get_dir_delegation_total node_nfs_free_stateid_avg_latency node_nfs_destroy_clientid_avg_latency]
    dashboard_test.go:1371: These 3 out of 112 counters haven't been used in dashboard from 9.12.0/nfsv4_1.yaml template [svm_nfs_read_latency_hist svm_nfs_latency_hist svm_nfs_write_latency_hist]
    dashboard_test.go:1371: These 4 out of 6 counters haven't been used in dashboard from 9.12.0/lif.yaml template [lif_sent_errors lif_sent_packet lif_recv_packet lif_recv_errors]
    dashboard_test.go:1371: These 9 out of 9 counters haven't been used in dashboard from 9.12.0/token_manager.yaml template [token_copy_success token_create_bytes token_zero_success token_copy_bytes token_copy_failure token_zero_bytes token_create_success token_create_failure token_zero_failure]
    dashboard_test.go:1371: These 10 out of 84 counters haven't been used in dashboard from 9.12.0/nfsv4.yaml template [svm_nfs_setclientid_total svm_nfs_release_lock_owner_total svm_nfs_setclientid_confirm_total svm_nfs_renew_total svm_nfs_renew_avg_latency svm_nfs_setclientid_confirm_avg_latency svm_nfs_setclientid_avg_latency svm_nfs_release_lock_owner_avg_latency svm_nfs_open_confirm_total svm_nfs_open_confirm_avg_latency]
    dashboard_test.go:1371: These 4 out of 5 counters haven't been used in dashboard from 9.12.0/copy_manager.yaml template [copy_manager_bce_copy_count_curr copy_manager_spince_copy_count_curr copy_manager_sce_copy_count_curr copy_manager_ocs_copy_count_curr]
    dashboard_test.go:1371: These 15 out of 17 counters haven't been used in dashboard from 9.12.0/ext_cache_obj.yaml template [flashcache_accesses flashcache_hit_directory flashcache_evicts flashcache_miss_indirect flashcache_hit flashcache_invalidates flashcache_usage flashcache_hit_indirect flashcache_miss_metadata_file flashcache_miss_directory flashcache_hit_metadata_file flashcache_miss_normal_lev0 flashcache_miss flashcache_inserts flashcache_hit_normal_lev0]
    dashboard_test.go:1371: These 5 out of 5 counters haven't been used in dashboard from 9.13.0/vscan.yaml template [vscan_scanner_stats_pct_mem_used vscan_scan_request_dispatched_rate vscan_scanner_stats_pct_cpu_used vscan_scan_latency vscan_scanner_stats_pct_network_used]
    dashboard_test.go:1371: These 8 out of 32 counters haven't been used in dashboard from 9.14.1/smb2.yaml template [smb2_oplock_break_latency_histogram smb2_close_latency_histogram smb2_query_info_latency_histogram smb2_lock_latency_histogram smb2_query_directory_latency_histogram smb2_set_info_latency_histogram smb2_create_latency_histogram smb2_session_setup_latency_histogram]
    dashboard_test.go:1371: These 3 out of 3 counters haven't been used in dashboard from 9.12.0/workload_detail_volume.yaml template [qos_detail_visits qos_detail_wait_time qos_detail_service_time]
    dashboard_test.go:1371: These 11 out of 11 counters haven't been used in dashboard from 9.14.1/nvmf_rdma_port.yaml template [nvmf_rdma_port_avg_write_latency nvmf_rdma_port_other_ops nvmf_rdma_port_avg_read_latency nvmf_rdma_port_avg_latency nvmf_rdma_port_total_data nvmf_rdma_port_total_ops nvmf_rdma_port_read_ops nvmf_rdma_port_read_data nvmf_rdma_port_write_ops nvmf_rdma_port_write_data nvmf_rdma_port_avg_other_latency]
    dashboard_test.go:1371: These 5 out of 11 counters haven't been used in dashboard from 9.12.0/resource_headroom_aggr.yaml template [headroom_aggr_ewma_daily headroom_aggr_optimal_point_confidence_factor headroom_aggr_ewma_monthly headroom_aggr_ewma_hourly headroom_aggr_ewma_weekly]
    dashboard_test.go:1371: These 128 out of 128 counters haven't been used in dashboard from 9.14.1/ontap_s3_svm.yaml template [ontaps3_svm_create_bucket_failed ontaps3_svm_head_object_failed_client_close ontaps3_svm_multi_delete_reqs ontaps3_svm_delete_object_failed ontaps3_svm_get_object_acl_total ontaps3_svm_put_bucket_versioning_total ontaps3_svm_signature_v2_reqs ontaps3_svm_get_object_acl_failed ontaps3_svm_initiate_multipart_upload_total ontaps3_svm_create_bucket_total ontaps3_svm_list_object_versions_failed ontaps3_svm_put_object_tagging_rate ontaps3_svm_list_buckets_failed ontaps3_svm_get_object_failed_client_close ontaps3_svm_put_object_latency ontaps3_svm_put_object_tagging_failed ontaps3_svm_upload_part_failed ontaps3_svm_delete_object_tagging_failed_client_close ontaps3_svm_list_objects_latency ontaps3_svm_head_bucket_failed_client_close ontaps3_svm_list_objects_failed_client_close ontaps3_svm_abort_multipart_upload_failed ontaps3_svm_delete_object_total ontaps3_svm_get_object_latency ontaps3_svm_delete_object_tagging_rate ontaps3_svm_delete_object_tagging_failed ontaps3_svm_list_objects_total ontaps3_svm_initiate_multipart_upload_failed_client_close ontaps3_svm_list_object_versions_rate ontaps3_svm_head_object_total ontaps3_svm_complete_multipart_upload_total ontaps3_svm_root_user_access ontaps3_svm_get_bucket_acl_total ontaps3_svm_input_flow_control_exit ontaps3_svm_list_objects_rate ontaps3_svm_delete_object_tagging_latency ontaps3_svm_delete_bucket_total ontaps3_svm_head_bucket_rate ontaps3_svm_list_uploads_total ontaps3_svm_get_bucket_acl_failed ontaps3_svm_complete_multipart_upload_latency ontaps3_svm_get_object_lastbyte_latency ontaps3_svm_delete_object_latency ontaps3_svm_presigned_url_reqs ontaps3_svm_delete_object_failed_client_close ontaps3_svm_put_object_rate ontaps3_svm_get_object_tagging_rate ontaps3_svm_max_cmds_per_connection ontaps3_svm_head_object_failed ontaps3_svm_abort_multipart_upload_rate ontaps3_svm_put_object_total ontaps3_svm_delete_object_rate ontaps3_svm_upload_part_total ontaps3_svm_default_deny_access ontaps3_svm_abort_multipart_upload_total ontaps3_svm_get_bucket_versioning_failed ontaps3_svm_list_uploads_failed_client_close ontaps3_svm_initiate_multipart_upload_failed ontaps3_svm_head_object_rate ontaps3_svm_put_object_tagging_latency ontaps3_svm_delete_bucket_failed_client_close ontaps3_svm_list_uploads_rate ontaps3_svm_delete_object_tagging_total ontaps3_svm_input_flow_control_entry ontaps3_svm_list_object_versions_failed_client_close ontaps3_svm_delete_bucket_rate ontaps3_svm_signature_v4_reqs ontaps3_svm_head_bucket_latency ontaps3_svm_put_object_failed_client_close ontaps3_svm_tagging ontaps3_svm_list_buckets_total ontaps3_svm_request_parse_errors ontaps3_svm_put_bucket_versioning_failed ontaps3_svm_list_object_versions_total ontaps3_svm_upload_part_failed_client_close ontaps3_svm_create_bucket_rate ontaps3_svm_complete_multipart_upload_failed ontaps3_svm_create_bucket_latency ontaps3_svm_complete_multipart_upload_failed_client_close ontaps3_svm_authentication_failures ontaps3_svm_initiate_multipart_upload_latency ontaps3_svm_create_bucket_failed_client_close ontaps3_svm_max_requests_outstanding ontaps3_svm_upload_part_latency ontaps3_svm_head_bucket_failed ontaps3_svm_list_uploads_failed ontaps3_svm_group_policy_evaluated ontaps3_svm_output_flow_control_exit ontaps3_svm_abort_multipart_upload_latency ontaps3_svm_requests_outstanding ontaps3_svm_get_object_rate ontaps3_svm_allow_access ontaps3_svm_get_object_tagging_total ontaps3_svm_abort_multipart_upload_failed_client_close ontaps3_svm_initiate_multipart_upload_rate ontaps3_svm_connected_connections ontaps3_svm_put_object_tagging_total ontaps3_svm_list_buckets_latency ontaps3_svm_head_bucket_total ontaps3_svm_list_buckets_rate ontaps3_svm_anonymous_deny_access ontaps3_svm_list_uploads_latency ontaps3_svm_put_data ontaps3_svm_get_object_total ontaps3_svm_get_bucket_versioning_total ontaps3_svm_anonymous_access ontaps3_svm_output_flow_control_entry ontaps3_svm_upload_part_rate ontaps3_svm_list_object_versions_latency ontaps3_svm_list_buckets_failed_client_close ontaps3_svm_requests ontaps3_svm_complete_multipart_upload_rate ontaps3_svm_list_objects_failed ontaps3_svm_max_connected_connections ontaps3_svm_put_object_tagging_failed_client_close ontaps3_svm_head_object_latency ontaps3_svm_get_object_tagging_failed ontaps3_svm_get_object_failed ontaps3_svm_delete_bucket_latency ontaps3_svm_get_object_tagging_latency ontaps3_svm_chunked_upload_reqs ontaps3_svm_connections ontaps3_svm_get_object_tagging_failed_client_close ontaps3_svm_explicit_deny_access ontaps3_svm_delete_bucket_failed ontaps3_svm_put_object_failed ontaps3_svm_server_connection_close ontaps3_svm_get_data]
    dashboard_test.go:1371: These 6 out of 17 counters haven't been used in dashboard from 9.12.0/wafl_hya_per_aggr.yaml template [flashpool_hya_write_ssd_latency_average flashpool_hya_write_hdd_latency_average flashpool_ssd_available flashpool_write_blks_replaced_percent flashpool_write_blks_replaced flashpool_ssd_total_used]
    dashboard_test.go:1371: These 18 out of 51 counters haven't been used in dashboard from 9.12.0/nfsv3_node.yaml template [node_nfs_fsstat_total node_nfs_readdirplus_total node_nfs_readdirplus_avg_latency node_nfs_mkdir_total node_nfs_fsinfo_avg_latency node_nfs_mknod_avg_latency node_nfs_rmdir_avg_latency node_nfs_read_symlink_total node_nfs_mkdir_avg_latency node_nfs_symlink_total node_nfs_read_symlink_avg_latency node_nfs_symlink_avg_latency node_nfs_rmdir_total node_nfs_fsinfo_total node_nfs_pathconf_total node_nfs_fsstat_avg_latency node_nfs_pathconf_avg_latency node_nfs_mknod_total]
    dashboard_test.go:1371: These 11 out of 11 counters haven't been used in dashboard from 9.14.1/nvmf_tcp_port.yaml template [nvmf_tcp_port_avg_other_latency nvmf_tcp_port_avg_write_latency nvmf_tcp_port_total_ops nvmf_tcp_port_read_data nvmf_tcp_port_avg_read_latency nvmf_tcp_port_other_ops nvmf_tcp_port_write_ops nvmf_tcp_port_avg_latency nvmf_tcp_port_total_data nvmf_tcp_port_read_ops nvmf_tcp_port_write_data]
    dashboard_test.go:1371: These 3 out of 11 counters haven't been used in dashboard from 9.12.0/cifs_vserver.yaml template [svm_cifs_established_sessions svm_cifs_signed_sessions svm_cifs_ops]
    dashboard_test.go:1371: These 4 out of 10 counters haven't been used in dashboard from 9.12.0/namespace.yaml template [namespace_remote_bytes namespace_remote_ops namespace_avg_other_latency namespace_other_ops]
    dashboard_test.go:1371: These 5 out of 20 counters haven't been used in dashboard from 9.12.0/lun.yaml template [lun_write_partial_blocks lun_read_partial_blocks lun_avg_xcopy_latency lun_queue_full lun_enospc]
    dashboard_test.go:1371: These 33 out of 34 counters haven't been used in dashboard from 9.12.0/volume_node.yaml template [node_vol_iscsi_read_latency node_vol_iscsi_other_ops node_vol_fcp_read_ops node_vol_fcp_read_data node_vol_nfs_other_ops node_vol_iscsi_write_data node_vol_cifs_write_latency node_vol_fcp_write_data node_vol_nfs_read_latency node_vol_cifs_other_latency node_vol_iscsi_write_latency node_vol_cifs_write_ops node_vol_nfs_read_ops node_vol_nfs_write_latency node_vol_cifs_read_data node_vol_nfs_write_ops node_vol_cifs_read_ops node_vol_nfs_write_data node_vol_nfs_other_latency node_vol_nfs_read_data node_vol_fcp_other_ops node_vol_fcp_write_ops node_vol_fcp_write_latency node_vol_iscsi_write_ops node_vol_iscsi_other_latency node_vol_cifs_write_data node_vol_cifs_other_ops node_vol_iscsi_read_ops node_vol_fcp_read_latency node_vol_iscsi_read_data node_vol_fcp_other_latency node_vol_cifs_read_latency node_vol_read_latency]
    dashboard_test.go:1371: These 14 out of 25 counters haven't been used in dashboard from 9.12.0/system_node.yaml template [node_fcp_data_recv node_cpu_elapsed_time node_total_data node_net_data_sent node_nvmf_data_sent node_hdd_data_read node_net_data_recv node_fcp_data_sent node_total_latency node_nvmf_data_recv node_ssd_data_written node_hdd_data_written node_ssd_data_read node_memory]
    dashboard_test.go:1371: These 2 out of 8 counters haven't been used in dashboard from 9.12.0/path.yaml template [path_total_iops path_total_data]
    dashboard_test.go:1371: These 34 out of 54 counters haven't been used in dashboard from 9.12.0/volume.yaml template [node_volume_nfs_access_ops volume_nfs_write_ops volume_nfs_access_ops volume_nfs_other_ops volume_nfs_setattr_latency volume_nfs_setattr_ops node_volume_nfs_read_latency node_volume_nfs_read_ops volume_nfs_other_latency node_volume_nfs_other_ops node_volume_nfs_getattr_ops volume_nfs_getattr_latency volume_nfs_total_ops volume_nfs_getattr_ops volume_nfs_access_latency volume_nfs_read_latency node_volume_nfs_setattr_ops node_volume_nfs_punch_hole_latency node_volume_nfs_access_latency volume_nfs_punch_hole_ops node_volume_nfs_other_latency volume_nfs_lookup_latency volume_nfs_punch_hole_latency volume_nfs_lookup_ops node_volume_nfs_lookup_latency volume_nfs_read_ops node_volume_nfs_getattr_latency node_volume_nfs_setattr_latency node_volume_nfs_write_ops volume_nfs_write_latency node_volume_nfs_total_ops node_volume_nfs_write_latency node_volume_nfs_punch_hole_ops node_volume_nfs_lookup_ops]
Hardikl commented 8 months ago

As discussed, we will disable the few templates where no counters are used in any dashboards and leave remaining template as-is. PR https://github.com/NetApp/harvest/pull/2587 will handle this. And closing this old PR https://github.com/NetApp/harvest/pull/2507.

cgrinds commented 7 months ago

Verified in 24.02 84e2f7ca

rg '#.*yaml' --glob 'conf/**/default.yaml' conf

conf/restperf/default.yaml
30:#  TokenManager:      token_manager.yaml
35:#  NFSv4Pool:         nfsv4_pool.yaml
48:#  NvmfRdmaPort:      nvmf_rdma_port.yaml
49:#  NvmfTcpPort:       nvmf_tcp_port.yaml
50:#  OntapS3SVM:        ontap_s3_svm.yaml
55:#  Vscan:             vscan.yaml
59:#  Workload:             workload.yaml
60:#  WorkloadVolume:       workload_volume.yaml
63:#  WorkloadDetail:       workload_detail.yaml
64:#  WorkloadDetailVolume: workload_detail_volume.yaml

conf/rest/default.yaml
13:#  CIFSSession:                 cifs_session.yaml
14:#  CIFSShare:                    cifs_share.yaml
19:#  ExportRule:                  exports.yaml
26:#  Mediator:                    mediator.yaml
28:#  NDMPSession:                 ndmp_sessions.yaml
29:#  NetConnections:              netconnections.yaml
30:#  NetPort:                     netport.yaml
32:#  NFSClients:                  nfs_clients.yaml

conf/zapiperf/default.yaml
22:#  Netstat:                  netstat.yaml
30:#  ObjectStoreClient:        object_store_client_op.yaml
35:#  TokenManager:             token_manager.yaml
40:#  NFSv4Pool:                nfsv4_pool.yaml
45:#  ExternalServiceOperation: external_service_operation.yaml
54:#  NvmfRdmaPort:             nvmf_rdma_port.yaml
55:#  NvmfTcpPort:              nvmf_tcp_port.yaml
56:#  OntapS3SVM:               ontap_s3_svm.yaml
61:#  Vscan:                    vscan.yaml
65:#  Workload:             workload.yaml
66:#  WorkloadVolume:       workload_volume.yaml
69:#  WorkloadDetail:       workload_detail.yaml
70:#  WorkloadDetailVolume: workload_detail_volume.yaml

conf/zapi/default.yaml
12:#  CIFSSession:                 cifs_session.yaml
13:#  CIFSShare:                   cifs_share.yaml
21:#  NetPort:                     netport.yaml