search

influxdata / telegraf

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
https://influxdata.com/telegraf
MIT License
14.55k stars 5.56k forks source link

vSphere Plugin - vSAN data only returns for 1 cluster when multiple clusters are present #13776

Open vdudejon opened 1 year ago

vdudejon commented 1 year ago

Relevant telegraf.conf

[agent]
collection_jitter = "10s"
debug = true
flush_interval = "20s"
flush_jitter = "5s"
hostname = ""
interval = "25s"
logfile = "/var/log/telegraf/telegraf.log"
metric_batch_size = 100000
metric_buffer_limit = 500000
omit_hostname = false
precision = ""
quiet = false
round_interval = false
[tags]
t-collector = "watchman-telegraf-lab"
[[outputs.influxdb]]
  urls = ["victoriametrics"]
[[outputs.file]]
  files = ["/etc/telegraf/output.out"]
  data_format = "influx"

#Historical Metrics
[[inputs.vsphere]]
  interval = "5m"
  vcenters = [ "https://vcenter/sdk" ]
  username = "user"
  password = "password"
  timeout = "290s"
  insecure_skip_verify = true

  # Define vsan metrics
  vsan_metric_include = ["performance.cluster-domclient",
                         "performance.cluster-domcompmgr",
                         "performance.host-domclient",
                         "performance.host-domcompmgr",
                         "performance.disk-group",
                         "performance.virtual-machine",
                         "performance.virtual-disk",
                         "performance.host-cpu"
                        ]
  vsan_metric_exclude = [""]
  vsan_cluster_include = ["/*/host/*Cloud**"]
  #vsan_metric_skip_verify = true
  # Exclude all other metrics
  vm_metric_exclude = ["*"]
  host_metric_exclude = ["*"]
  datastore_metric_include = ["*"]
  cluster_metric_include = ["*"]
  datacenter_metric_include = ["*"]
  resource_pool_metric_exclude = ["*"]

  ## number of go routines to use for collection and discovery of objects and metrics
  collect_concurrency = 4
  discover_concurrency = 4
  # custom_attribute_include = []
  # custom_attribute_exclude = ["*"]

# Realtime metrics
[[inputs.vsphere]]
  interval = "20s"
  vcenters = [ "https://vcenter/sdk" ]
  username = "user"
  password = "password"
  timeout = "19s"
  insecure_skip_verify = true

  # Define vsan metrics
  vsan_metric_include = ["summary.*"]
  vsan_metric_exclude = [""]
  vsan_cluster_include = ["/*/host/*Cloud**"]
  #vsan_metric_skip_verify = true
  # Exclude all other metrics
  vm_metric_exclude = ["*"]
  host_metric_exclude = ["*"]
  datastore_metric_exclude = ["*"]
  cluster_metric_exclude = ["*"]
  datacenter_metric_exclude = ["*"]
  resource_pool_metric_exclude = ["*"]

  ## number of go routines to use for collection and discovery of objects and metrics
  collect_concurrency = 5
  discover_concurrency = 5
  # custom_attribute_include = []
  # custom_attribute_exclude = ["*"]

Logs from Telegraf

2023-08-16T13:46:53Z I! Starting Telegraf 1.27.3
2023-08-16T13:46:53Z I! Available plugins: 237 inputs, 9 aggregators, 28 processors, 23 parsers, 59 outputs, 4 secret-stores
2023-08-16T13:46:53Z I! Loaded inputs: vsphere (2x)
2023-08-16T13:46:53Z I! Loaded aggregators:
2023-08-16T13:46:53Z I! Loaded processors:
2023-08-16T13:46:53Z I! Loaded secretstores:
2023-08-16T13:46:53Z I! Loaded outputs: influxdb
2023-08-16T13:46:53Z I! Tags enabled: host=0125164ff35e t-collector=watchman-telegraf-lab
2023-08-16T13:46:53Z W! Deprecated inputs: 0 and 2 options
2023-08-16T13:46:53Z I! [agent] Config: Interval:25s, Quiet:false, Hostname:"0125164ff35e", Flush Interval:20s
2023-08-16T13:46:53Z D! [agent] Initializing plugins
2023-08-16T13:46:53Z D! [agent] Connecting outputs
2023-08-16T13:46:53Z D! [agent] Attempting connection to [outputs.influxdb]
2023-08-16T13:46:53Z D! [agent] Successfully connected to outputs.influxdb
2023-08-16T13:46:53Z D! [agent] Starting service inputs
2023-08-16T13:46:53Z I! [inputs.vsphere] Starting plugin
2023-08-16T13:46:53Z D! [inputs.vsphere] Creating client: vcenter
2023-08-16T13:46:53Z D! [inputs.vsphere] vCenter maxQueryMetrics is defined: 512
2023-08-16T13:46:53Z D! [inputs.vsphere] vCenter says max_query_metrics should be 512
2023-08-16T13:46:53Z D! [inputs.vsphere] Running initial discovery
2023-08-16T13:46:53Z D! [inputs.vsphere] Discover new objects for vcenter
2023-08-16T13:46:53Z D! [inputs.vsphere] Discovering resources for vm
2023-08-16T13:46:53Z D! [inputs.vsphere] Discovering resources for datastore
2023-08-16T13:46:53Z D! [inputs.vsphere] Find(Datastore, /*/datastore/**) returned 150 objects
2023-08-16T13:46:53Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e24_Local
2023-08-16T13:46:53Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e10_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e10_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e38_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e34_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 16 metrics for icdesxcan39e26-Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcar35e36_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e41_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e26_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e26_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e20_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e16_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e32
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 16 metrics for datastore1
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e12-Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e18_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 16 metrics for icdesxcan39e08-Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e28_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e36
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e02_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e32_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e12_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e22_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e41_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcar35e38_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxt20e34_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e40_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 16 metrics for icdesxt20e26_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e38
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 14 metrics for STL_Management_vSAN
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e34_Local
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e34
2023-08-16T13:46:54Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e41_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e22-Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e20_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 16 metrics for datastore1 (2)
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e28_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e08_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 16 metrics for icdesxcap35e14_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e02-Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxt20e30_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 16 metrics for icdesxcap39e32_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 16 metrics for icdesxcaq35e32_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e18-Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e22_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e16_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e06_Local
2023-08-16T13:46:55Z D! [inputs.vsphere] Found 16 metrics for icdesxcap39e26_Local
2023-08-16T13:47:31Z D! [inputs.vsphere] Found 14 metrics for STL_AOS_vsanDatastore
2023-08-16T13:47:31Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e22_Local
2023-08-16T13:47:31Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e28
2023-08-16T13:47:31Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e32_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 16 metrics for icdesxcap35e20_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e24_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e04_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 16 metrics for icdesxcaq35e36_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e26_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e06_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e30_Local
2023-08-16T13:47:32Z D! [inputs.vsphere] Found 16 metrics for icdesxcan35e38_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 16 metrics for icdesxcaq39e20_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e34_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 16 metrics for icdesxcan35e10-Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e36_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 16 metrics for icdesxt20e32_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e12_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 16 metrics for icdesxt20e20_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e24_Local
2023-08-16T13:47:33Z D! [inputs.vsphere] Found 16 metrics for icdesxcaq35e08_Local
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e36_Local
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e36-Local
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e04-Local
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 14 metrics for STL-LogRepository
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 16 metrics for datastore1 (1)
2023-08-16T13:47:34Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e28_Local
2023-08-16T13:47:35Z D! [inputs.vsphere] Found 15 metrics for icdesxcas35e36_Local
2023-08-16T13:47:35Z D! [inputs.vsphere] Found 15 metrics for icdesxcap39e36_Local
2023-08-16T13:47:35Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e40-Local
2023-08-16T13:47:37Z D! [inputs.vsphere] Found 14 metrics for STL_AOS_State_Street_vsanDatastore
2023-08-16T13:47:37Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e04_Local
2023-08-16T13:47:37Z D! [inputs.vsphere] Found 15 metrics for icdesxcan39e10_Local
2023-08-16T13:47:38Z D! [inputs.vsphere] Found 15 metrics for icdesxcar35e26_Local
2023-08-16T13:47:38Z D! [inputs.vsphere] Found 15 metrics for boot-icdesxcap35e40
2023-08-16T13:47:44Z D! [inputs.vsphere] Found 14 metrics for STL_Cloud_04_VSAN
2023-08-16T13:47:44Z D! [inputs.vsphere] Found 15 metrics for icdesxcar35e24_Local
2023-08-16T13:47:45Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e18_Local
2023-08-16T13:47:45Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e32_Local
2023-08-16T13:47:45Z D! [inputs.vsphere] Found 15 metrics for icdesxcan35e14-Local
2023-08-16T13:47:45Z D! [inputs.vsphere] Found 16 metrics for icdesxt20e24_Local
2023-08-16T13:47:45Z D! [inputs.vsphere] Found 15 metrics for icdesxcar35e34_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 14 metrics for STL_Cloud_01_VSAN
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 15 metrics for icdesxcap35e16_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 14 metrics for STL_AOS_02_vsanDatastore
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq39e30_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 16 metrics for icdesxcap39e20_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e30_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 14 metrics for STL_Cloud_06_VSAN
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e40_Local
2023-08-16T13:47:46Z D! [inputs.vsphere] Found 15 metrics for icdesxcaq35e24_Local
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 14 metrics for STL_Cloud_03_vSAN
2023-08-16T13:48:14Z D! [inputs.vsphere] Discovering resources for vsan
2023-08-16T13:48:14Z D! [inputs.vsphere] Find(ClusterComputeResource, /*/host/*Cloud**) returned 7 objects
2023-08-16T13:48:14Z D! [inputs.vsphere] Discovering resources for datacenter
2023-08-16T13:48:14Z D! [inputs.vsphere] Find(Datacenter, /*) returned 2 objects
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 20 metrics for St Louis
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 20 metrics for St Louis - Advent
2023-08-16T13:48:14Z D! [inputs.vsphere] Discovering resources for cluster
2023-08-16T13:48:14Z D! [inputs.vsphere] Find(ClusterComputeResource, /*/host/**) returned 14 objects
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 42 metrics for STL_Cloud_06
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_AOS
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Management
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 37 metrics for AutoDeploy
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_AOS_02
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Cloud_03
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Cloud_05
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 37 metrics for ProdReady
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_AOS_State_Street
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 42 metrics for STL_Cloud_07
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Cloud_01
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Cloud_04
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 37 metrics for Maintenance
2023-08-16T13:48:14Z D! [inputs.vsphere] Found 43 metrics for STL_Cloud_02
2023-08-16T13:48:14Z D! [inputs.vsphere] Discovering resources for resourcepool
2023-08-16T13:48:14Z D! [inputs.vsphere] Find(ResourcePool, /*/host/**) returned 14 objects
2023-08-16T13:48:14Z D! [inputs.vsphere] Discovering resources for host
2023-08-16T13:48:14Z D! [inputs.vsphere] Find(HostSystem, /*/host/**) returned 137 objects
2023-08-16T13:48:14Z I! [inputs.vsphere] Starting plugin
2023-08-16T13:48:14Z D! [inputs.vsphere] Creating client: vcenter
2023-08-16T13:48:15Z D! [inputs.vsphere] vCenter maxQueryMetrics is defined: 512
2023-08-16T13:48:15Z D! [inputs.vsphere] vCenter says max_query_metrics should be 512
2023-08-16T13:48:15Z D! [inputs.vsphere] Running initial discovery
2023-08-16T13:48:15Z D! [inputs.vsphere] Discover new objects for vcenter
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for host
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(HostSystem, /*/host/**) returned 137 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for vm
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for datastore
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(Datastore, /*/datastore/**) returned 150 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for vsan
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(ClusterComputeResource, /*/host/*Cloud**) returned 7 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for datacenter
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(Datacenter, /*) returned 2 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for cluster
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(ClusterComputeResource, /*/host/**) returned 14 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Discovering resources for resourcepool
2023-08-16T13:48:15Z D! [inputs.vsphere] Find(ResourcePool, /*/host/**) returned 14 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] Interval estimated to 1m0s
2023-08-16T13:48:15Z D! [inputs.vsphere] Collecting metrics for 14 objects of type cluster for vcenter
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (34 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (24 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (14 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting partial query: 10 metrics (4 remaining) of type cluster for vcenter. Total objects 14
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting job for cluster: 14 objects, 42 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Interval estimated to 1m0s
2023-08-16T13:48:15Z D! [inputs.vsphere] Collecting metrics for 2 objects of type datacenter for vcenter
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting job for datacenter: 2 objects, 40 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datacenter has 2 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Interval estimated to 1m0s
2023-08-16T13:48:15Z D! [inputs.vsphere] Collecting metrics for 150 objects of type datastore for vcenter
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting final bucket job for datastore: 272 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Submitting job for datastore: 14 objects, 224 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 14 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for datacenter returned metrics for 2 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for datacenter returned 120 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for datacenter returned 120 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Latest sample for datacenter set to 2023-08-16 13:45:00 +0000 UTC
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:15Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 14 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 120 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 120 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:15Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 15 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:16.08030311 +0000 UTC ~ 2023-08-16 13:48:16.08030311 +0000 UTC
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:16.097688399 +0000 UTC ~ 2023-08-16 13:48:16.097688399 +0000 UTC
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 21 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:16.14289007 +0000 UTC ~ 2023-08-16 13:48:16.14289007 +0000 UTC
2023-08-16T13:48:16Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:16.148739418 +0000 UTC ~ 2023-08-16 13:48:16.148739418 +0000 UTC
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 18 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 24 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 0 metrics
2023-08-16T13:48:16Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Latest sample for cluster set to 2023-08-16 13:45:00 +0000 UTC
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:16Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:17Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:17Z D! [inputs.vsphere] Missing value for: datastore.numberReadAveraged.average, IC-LogRepository
2023-08-16T13:48:17Z D! [inputs.vsphere] Missing value for: datastore.numberWriteAveraged.average, IC-LogRepository
2023-08-16T13:48:17Z D! [inputs.vsphere] CollectChunk for datastore returned 249 metrics
2023-08-16T13:48:17Z D! [inputs.vsphere] CollectChunk for datastore returned 249 metrics
2023-08-16T13:48:17Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:20Z D! [inputs.vsphere] Missing value for: datastore.numberReadAveraged.average, STL-LogRepository
2023-08-16T13:48:20Z D! [inputs.vsphere] Missing value for: datastore.numberWriteAveraged.average, STL-LogRepository
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 225 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 225 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore has 14 QuerySpecs
2023-08-16T13:48:20Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:20.622436516 +0000 UTC
2023-08-16T13:48:20Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:20.631687803 +0000 UTC
2023-08-16T13:48:20Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:20.677034333 +0000 UTC
2023-08-16T13:48:20Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:20.68325746 +0000 UTC
2023-08-16T13:48:20Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:20.694485478 +0000 UTC
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] CollectChunk for datastore returned 243 metrics
2023-08-16T13:48:20Z D! [inputs.vsphere] Query for datastore has 17 QuerySpecs
2023-08-16T13:48:21Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:21Z D! [inputs.vsphere] CollectChunk for datastore returned 255 metrics
2023-08-16T13:48:21Z D! [inputs.vsphere] CollectChunk for datastore returned 255 metrics
2023-08-16T13:48:21Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:21Z D! [inputs.vsphere] CollectChunk for datastore returned 219 metrics
2023-08-16T13:48:21Z D! [inputs.vsphere] CollectChunk for datastore returned 219 metrics
2023-08-16T13:48:22Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:22.808771226 +0000 UTC
2023-08-16T13:48:22Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:48:22.815604628 +0000 UTC
2023-08-16T13:48:22Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 1 remaining
2023-08-16T13:48:23Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:40:00 +0000 UTC ~ 2023-08-16 13:48:23.347815816 +0000 UTC
2023-08-16T13:48:23Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:40:00 +0000 UTC ~ 2023-08-16 13:48:23.414349054 +0000 UTC
2023-08-16T13:48:23Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:40:00 +0000 UTC ~ 2023-08-16 13:48:23.738312557 +0000 UTC
2023-08-16T13:48:23Z D! [inputs.vsphere] Query for datastore returned metrics for 14 objects
2023-08-16T13:48:23Z D! [inputs.vsphere] CollectChunk for datastore returned 198 metrics
2023-08-16T13:48:23Z D! [inputs.vsphere] CollectChunk for datastore returned 198 metrics
2023-08-16T13:48:29Z D! [inputs.vsphere] Query for datastore returned metrics for 17 objects
2023-08-16T13:48:29Z D! [inputs.vsphere] CollectChunk for datastore returned 228 metrics
2023-08-16T13:48:29Z D! [inputs.vsphere] CollectChunk for datastore returned 228 metrics
2023-08-16T13:48:29Z D! [inputs.vsphere] Latest sample for datastore set to 2023-08-16 13:50:00 +0000 UTC
2023-08-16T13:48:29Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 1323 remaining
2023-08-16T13:48:40Z D! [outputs.influxdb] Wrote batch of 43508 metrics in 421.399691ms
2023-08-16T13:48:40Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:48:54Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:48:54.230557577 +0000 UTC
2023-08-16T13:48:54Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:48:54.308322568 +0000 UTC
2023-08-16T13:48:54Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:48:54.397265115 +0000 UTC
2023-08-16T13:48:54Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:48:54.433742917 +0000 UTC
2023-08-16T13:48:54Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:48:54.440033826 +0000 UTC
2023-08-16T13:48:59Z D! [inputs.vsphere] Previous collection has not completed; scheduled collection skipped
2023-08-16T13:49:01Z D! [outputs.influxdb] Wrote batch of 10 metrics in 2.719151ms
2023-08-16T13:49:01Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:49:03Z W! [inputs.vsphere] Collection took longer than expected; not complete after interval of 20s
2023-08-16T13:49:04Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:49:04.248892748 +0000 UTC
2023-08-16T13:49:04Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:54.230557577 +0000 UTC ~ 2023-08-16 13:49:04.257768015 +0000 UTC
2023-08-16T13:49:04Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 2 remaining
2023-08-16T13:49:23Z D! [outputs.influxdb] Wrote batch of 4 metrics in 1.464584ms
2023-08-16T13:49:23Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:49:24Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:24.453017867 +0000 UTC
2023-08-16T13:49:24Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:24.472976245 +0000 UTC
2023-08-16T13:49:24Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:24.507346209 +0000 UTC
2023-08-16T13:49:24Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:24.524527758 +0000 UTC
2023-08-16T13:49:24Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:24.53043686 +0000 UTC
2023-08-16T13:49:27Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:27.926940887 +0000 UTC
2023-08-16T13:49:27Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:49:27.935221993 +0000 UTC
2023-08-16T13:49:27Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 2 remaining
2023-08-16T13:49:47Z D! [outputs.influxdb] Wrote batch of 14 metrics in 1.031621ms
2023-08-16T13:49:47Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:49:58Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:49:58.115663119 +0000 UTC
2023-08-16T13:49:58Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:49:58.135052608 +0000 UTC
2023-08-16T13:49:58Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:49:58.174547768 +0000 UTC
2023-08-16T13:49:58Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:49:58.184536232 +0000 UTC
2023-08-16T13:49:58Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:49:58.19799957 +0000 UTC
2023-08-16T13:49:58Z D! [inputs.vsphere] Previous collection has not completed; scheduled collection skipped
2023-08-16T13:49:59Z W! [inputs.vsphere] Collection took longer than expected; not complete after interval of 20s
2023-08-16T13:50:04Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:50:04.375801266 +0000 UTC
2023-08-16T13:50:04Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:34:58.115663119 +0000 UTC ~ 2023-08-16 13:50:04.380155725 +0000 UTC
2023-08-16T13:50:04Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 3 remaining
2023-08-16T13:50:09Z D! [outputs.influxdb] Wrote batch of 14 metrics in 1.739768ms
2023-08-16T13:50:09Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:50:21Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:21.368493841 +0000 UTC
2023-08-16T13:50:21Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:21.416132224 +0000 UTC
2023-08-16T13:50:21Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:21.450107238 +0000 UTC
2023-08-16T13:50:21Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:21.46517488 +0000 UTC
2023-08-16T13:50:21Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:21.480164828 +0000 UTC
2023-08-16T13:50:25Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:25.382644237 +0000 UTC
2023-08-16T13:50:25Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:35:21.368493841 +0000 UTC ~ 2023-08-16 13:50:25.402887918 +0000 UTC
2023-08-16T13:50:25Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 4 remaining
2023-08-16T13:50:33Z D! [outputs.influxdb] Wrote batch of 14 metrics in 1.422782ms
2023-08-16T13:50:33Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics
2023-08-16T13:50:47Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:47.776624496 +0000 UTC
2023-08-16T13:50:47Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:47.801380267 +0000 UTC
2023-08-16T13:50:47Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:47.825975012 +0000 UTC
2023-08-16T13:50:47Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:47.839683638 +0000 UTC
2023-08-16T13:50:47Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:47.843820014 +0000 UTC
2023-08-16T13:50:49Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:49.668267561 +0000 UTC
2023-08-16T13:50:49Z D! [inputs.vsphere] [vSAN] Query vsan performance for time interval: 2023-08-16 13:33:20.622436516 +0000 UTC ~ 2023-08-16 13:50:49.672488492 +0000 UTC
2023-08-16T13:50:49Z D! [inputs.vsphere] purged timestamp cache. 0 deleted with 4 remaining
2023-08-16T13:50:53Z D! [outputs.influxdb] Wrote batch of 14 metrics in 997.994µs
2023-08-16T13:50:53Z D! [outputs.influxdb] Buffer fullness: 0 / 500000 metrics

System info

Docker 24.0.2, vSphere 7u3 with 8 vSAN clusters

Docker

No response

Steps to reproduce

  1. Configure telegraf to collect vsan metrics against a vcenter with multiple vsan (or mixed vsan/non vsan) clusters as default, or with a filter that will return more than 1 cluster
  2. Observe that per collection, only data for 1 vsan cluster is returned

(Not present in these logs) I have also observed that if there is a non-vsan cluster in the vcenter, telegraf will see that cluster and say that it is skipping it, but then no vsan metrics are returned at all.

Expected behavior

Metrics should return for all vsan clusters in the vcenter.

Actual behavior

Metrics are only returned for 1 vCenter

Additional info

I believe this is the root cause of this issue, and there is additional discussion in that thread: https://github.com/influxdata/telegraf/issues/13609

This is a good visualization to show the behavior. This is showing vsphere_vsan_summary_total_capacity_byte which is a realtime metric. There should be data points for every cluster every 20 seconds, but you can see that it's random as to which vsan cluster is returning data at each collection.

image
powersj commented 1 year ago

Hi,

Can you please disable all other vsphere metrics and only try to collect metrics for the various vsan.

Then add the [[outputs.file]] output, collect metrics for a couple of minutes, and provide the logs please?

Thanks

vdudejon commented 1 year ago

Sure, here is a a selection from the [output.file] output. I only put a few lines of the historical stats (vsphere_vsanperformance*) because there are so many lines, but it is only returning for 1 cluster (STL_Cloud_02).

vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899856537092176i,total_capacity_byte=1536298057728000i 1692384807000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=1536298057728000i,free_capacity_byte=899856537092176i 1692384807000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899856537092176i,total_capacity_byte=1536298057728000i 1692384807000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899856537092176i,total_capacity_byte=1536298057728000i 1692384807000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899856537092176i,total_capacity_byte=1536298057728000i 1692384807000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384808000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384808000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384808000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384808000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384808000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899980109676624i,total_capacity_byte=1536298057728000i 1692384816000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=899980109676624i,total_capacity_byte=1536298057728000i 1692384816000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384816000000000
vsphere_vsan_summary,clustername=STL_Cloud_05,dcname=St\ Louis,host=0125164ff35e,moid=domain-c547713,source=STL_Cloud_05,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384816000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504623439590288i,total_capacity_byte=1782105746964480i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504623439590288i,total_capacity_byte=1782105746964480i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504623439590288i,total_capacity_byte=1782105746964480i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504623439590288i,total_capacity_byte=1782105746964480i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504623439590288i,total_capacity_byte=1782105746964480i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384835000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384836000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384836000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384836000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384836000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384836000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504613243237264i,total_capacity_byte=1782105746964480i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504613243237264i,total_capacity_byte=1782105746964480i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384839000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587170293153832i,total_capacity_byte=768149028864000i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587170293153832i,total_capacity_byte=768149028864000i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587170293153832i,total_capacity_byte=768149028864000i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587170293153832i,total_capacity_byte=768149028864000i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587170293153832i,total_capacity_byte=768149028864000i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384849000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=768149028864000i,free_capacity_byte=587167474581544i 1692384853000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587167474581544i,total_capacity_byte=768149028864000i 1692384853000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384854000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384854000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=384074514432000i,free_capacity_byte=183668836368404i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668836368404i,total_capacity_byte=384074514432000i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=384074514432000i,free_capacity_byte=183668836368404i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668836368404i,total_capacity_byte=384074514432000i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668836368404i,total_capacity_byte=384074514432000i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384872000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668823785492i,total_capacity_byte=384074514432000i 1692384878000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668823785492i,total_capacity_byte=384074514432000i 1692384878000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384878000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384878000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384890000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384893000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670898140048i,total_capacity_byte=1782105746964480i 1692384893000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384894000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384894000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384894000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384894000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670713590672i,total_capacity_byte=1782105746964480i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670713590672i,total_capacity_byte=1782105746964480i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670713590672i,total_capacity_byte=1782105746964480i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=1782105746964480i,free_capacity_byte=1504670713590672i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670713590672i,total_capacity_byte=1782105746964480i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384908000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670646481808i,total_capacity_byte=1782105746964480i 1692384911000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670646481808i,total_capacity_byte=1782105746964480i 1692384911000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384911000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384911000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384912000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384912000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587163032813608i,total_capacity_byte=768149028864000i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587163032813608i,total_capacity_byte=768149028864000i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587163032813608i,total_capacity_byte=768149028864000i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=768149028864000i,free_capacity_byte=587163032813608i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587163032813608i,total_capacity_byte=768149028864000i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384931000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587162516914216i,total_capacity_byte=768149028864000i 1692384934000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587162516914216i,total_capacity_byte=768149028864000i 1692384934000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384934000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384934000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=384074514432000i,free_capacity_byte=183668991557652i 1692384950000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668991557652i,total_capacity_byte=384074514432000i 1692384950000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668991557652i,total_capacity_byte=384074514432000i 1692384950000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668991557652i,total_capacity_byte=384074514432000i 1692384950000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668991557652i,total_capacity_byte=384074514432000i 1692384950000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384951000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384951000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384951000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384951000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384951000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=183668991557652i,total_capacity_byte=384074514432000i 1692384953000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=384074514432000i,free_capacity_byte=183668991557652i 1692384953000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384953000000000
vsphere_vsan_summary,clustername=STL_Cloud_01,dcname=St\ Louis,host=0125164ff35e,moid=domain-c11,source=STL_Cloud_01,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384953000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670361269136i,total_capacity_byte=1782105746964480i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670361269136i,total_capacity_byte=1782105746964480i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670361269136i,total_capacity_byte=1782105746964480i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=1782105746964480i,free_capacity_byte=1504670361269136i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670361269136i,total_capacity_byte=1782105746964480i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384969000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384970000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384970000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384970000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384970000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384970000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504670361269136i,total_capacity_byte=1782105746964480i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=1782105746964480i,free_capacity_byte=1504670361269136i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384973000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589209145416i,total_capacity_byte=1382668251955200i 1692384986000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589209145416i,total_capacity_byte=1382668251955200i 1692384986000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589209145416i,total_capacity_byte=1382668251955200i 1692384986000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589209145416i,total_capacity_byte=1382668251955200i 1692384986000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589209145416i,total_capacity_byte=1382668251955200i 1692384986000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384987000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384987000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384987000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692384987000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384987000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589204951112i,total_capacity_byte=1382668251955200i 1692384989000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589204951112i,total_capacity_byte=1382668251955200i 1692384989000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692384989000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692384989000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=1782105746964480i,free_capacity_byte=1504669442716560i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669442716560i,total_capacity_byte=1782105746964480i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669442716560i,total_capacity_byte=1782105746964480i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669442716560i,total_capacity_byte=1782105746964480i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669442716560i,total_capacity_byte=1782105746964480i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385015000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669430133648i,total_capacity_byte=1782105746964480i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669430133648i,total_capacity_byte=1782105746964480i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385019000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385035000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385043000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=863589179785288i,total_capacity_byte=1382668251955200i 1692385043000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385043000000000
vsphere_vsan_summary,clustername=STL_Cloud_03,dcname=St\ Louis,host=0125164ff35e,moid=domain-c18468,source=STL_Cloud_03,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385043000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669258167184i,total_capacity_byte=1782105746964480i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669258167184i,total_capacity_byte=1782105746964480i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669258167184i,total_capacity_byte=1782105746964480i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669258167184i,total_capacity_byte=1782105746964480i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504669258167184i,total_capacity_byte=1782105746964480i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692385058000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504573187634064i,total_capacity_byte=1782105746964480i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504573187634064i,total_capacity_byte=1782105746964480i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385061000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668792599440i,total_capacity_byte=1782105746964480i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668792599440i,total_capacity_byte=1782105746964480i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668792599440i,total_capacity_byte=1782105746964480i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668792599440i,total_capacity_byte=1782105746964480i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668792599440i,total_capacity_byte=1782105746964480i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385075000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_objects_to_sync=0i,total_recovery_eta=0i,total_bytes_to_sync=0i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385076000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668700324752i,total_capacity_byte=1782105746964480i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1504668700324752i,total_capacity_byte=1782105746964480i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter overall_health=2i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_07,dcname=St\ Louis,host=0125164ff35e,moid=domain-c769805,source=STL_Cloud_07,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385079000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587193307299880i,total_capacity_byte=768149028864000i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_capacity_byte=768149028864000i,free_capacity_byte=587193307299880i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587193307299880i,total_capacity_byte=768149028864000i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587193307299880i,total_capacity_byte=768149028864000i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587193307299880i,total_capacity_byte=768149028864000i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_recovery_eta=0i,total_bytes_to_sync=0i,total_objects_to_sync=0i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385092000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587192975949864i,total_capacity_byte=768149028864000i 1692385095000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=587192975949864i,total_capacity_byte=768149028864000i 1692385095000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385095000000000
vsphere_vsan_summary,clustername=STL_Cloud_06,dcname=St\ Louis,host=0125164ff35e,moid=domain-c564854,source=STL_Cloud_06,t-collector=watchman-telegraf-lab,vcenter=vcenter total_bytes_to_sync=0i,total_objects_to_sync=0i,total_recovery_eta=0i 1692385095000000000
vsphere_vsan_summary,clustername=STL_Cloud_04,dcname=St\ Louis,host=0125164ff35e,moid=domain-c273543,source=STL_Cloud_04,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1227139021930576i,total_capacity_byte=1536298057728000i 1692385112000000000
vsphere_vsan_summary,clustername=STL_Cloud_04,dcname=St\ Louis,host=0125164ff35e,moid=domain-c273543,source=STL_Cloud_04,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1227139021930576i,total_capacity_byte=1536298057728000i 1692385112000000000
vsphere_vsan_summary,clustername=STL_Cloud_04,dcname=St\ Louis,host=0125164ff35e,moid=domain-c273543,source=STL_Cloud_04,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1227139021930576i,total_capacity_byte=1536298057728000i 1692385112000000000
vsphere_vsan_summary,clustername=STL_Cloud_04,dcname=St\ Louis,host=0125164ff35e,moid=domain-c273543,source=STL_Cloud_04,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1227139021930576i,total_capacity_byte=1536298057728000i 1692385112000000000
vsphere_vsan_summary,clustername=STL_Cloud_04,dcname=St\ Louis,host=0125164ff35e,moid=domain-c273543,source=STL_Cloud_04,t-collector=watchman-telegraf-lab,vcenter=vcenter free_capacity_byte=1227139021930576i,total_capacity_byte=1536298057728000i 1692385112000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter latency_max_read=34641,latency_max_write=1368068,unmap_count=0,latency_avg=1976,latency_stddev=13604,io_count=258151,congestion=0,write_count=164620,latency_stddev_read=432,iops=860,iops_read=311,read_count=93531,throughput_write=4723185,throughput=7835916,latency_avg_unmap=0,latency_stddev_unmap=0,throughput_read=3112730,read_congestion=0,throughput_unmap=0,unmap_congestion=0,latency_max_unmap=0,iops_write=548,client_cache_hits=274,oio=5,latency_avg_write=3029,num_oio=1321773,iops_unmap=0,latency_stddev_write=16943,latency_avg_read=122,client_cache_hit_rate=90,write_congestion=0 1692384300000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter io_count=377560,read_congestion=0,latency_avg_write=2158,write_count=238342,client_cache_hits=307,unmap_congestion=0,throughput=12664288,throughput_read=7650729,client_cache_hit_rate=68,latency_stddev_write=2949,iops=1258,latency_stddev=2538,oio=4,latency_avg_read=227,iops_unmap=0,latency_stddev_read=481,latency_stddev_unmap=0,latency_avg=1446,throughput_write=5013558,num_oio=1519863,latency_max_write=67211,iops_write=794,throughput_unmap=0,unmap_count=0,latency_max_unmap=0,congestion=0,latency_max_read=9823,latency_avg_unmap=0,iops_read=463,read_count=139218,write_congestion=0 1692384600000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter throughput=6673015,client_cache_hits=328,client_cache_hit_rate=87,congestion=0,iops_unmap=0,unmap_count=0,latency_max_unmap=0,latency_stddev_write=3722,latency_avg=1574,latency_avg_write=2639,latency_max_read=7347,latency_max_write=81582,latency_avg_unmap=0,latency_avg_read=143,read_congestion=0,num_oio=1432070,latency_stddev_read=415,oio=5,throughput_write=3442054,latency_stddev_unmap=0,io_count=285337,read_count=121749,iops=951,throughput_read=3230961,write_count=163588,unmap_congestion=0,latency_stddev=3089,iops_read=405,iops_write=545,write_congestion=0,throughput_unmap=0 1692384900000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter throughput=7437317,io_count=302815,latency_avg_read=112,iops_write=512,write_count=153674,iops_unmap=0,num_oio=1293651,latency_max_unmap=0,latency_stddev_read=361,read_count=149141,client_cache_hits=421,latency_stddev=3709,unmap_count=0,latency_stddev_write=4826,congestion=0,throughput_read=4574429,latency_avg_write=2851,latency_max_read=10115,throughput_unmap=0,iops_read=497,client_cache_hit_rate=84,read_congestion=0,unmap_congestion=0,latency_stddev_unmap=0,latency_avg_unmap=0,iops=1009,latency_avg=1502,oio=4,throughput_write=2862887,write_congestion=0,latency_max_write=255399 1692384000000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter write_congestion=0,latency_max_read=747090,latency_max_write=747545,latency_stddev_read=1300,latency_avg_read=970,oio=26,read_count=1922666,client_cache_hit_rate=5,throughput_unmap=0,latency_avg=2045,unmap_congestion=0,latency_stddev_write=5531,throughput_write=9918010,latency_avg_write=4687,read_congestion=0,latency_max_unmap=0,iops_read=6411,unmap_count=0,latency_stddev_unmap=0,throughput=189261024,client_cache_hits=418,num_oio=71279440,congestion=0,iops_write=2609,write_count=782381,iops_unmap=0,io_count=2705047,latency_stddev=3590,throughput_read=179343008,latency_avg_unmap=0,iops=9020 1692384000000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter latency_max_unmap=0,iops_write=2704,iops_unmap=0,throughput_unmap=0,throughput=211102400,oio=28,latency_avg_unmap=0,client_cache_hits=274,read_congestion=0,num_oio=112724888,latency_stddev_write=11163,iops_read=10463,throughput_read=196972128,latency_avg_write=4813,latency_stddev_read=2450,iops=13167,latency_avg_read=859,write_count=811548,unmap_count=0,latency_max_read=933670,unmap_congestion=0,latency_avg=1671,congestion=0,client_cache_hit_rate=2,latency_stddev_unmap=0,io_count=3951002,throughput_write=14130271,write_congestion=0,latency_stddev=5737,read_count=3139454,latency_max_write=1364764 1692384300000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter latency_max_unmap=0,iops_write=3151,client_cache_hits=340,read_congestion=0,latency_max_read=35985,latency_avg=1624,io_count=3082531,write_count=945268,client_cache_hit_rate=4,latency_stddev=2727,iops_read=7126,latency_avg_write=3385,throughput_unmap=0,throughput=196125552,congestion=0,throughput_read=181388432,unmap_count=0,latency_max_write=109593,iops_unmap=0,latency_stddev_write=4209,latency_avg_read=845,throughput_write=14737119,latency_avg_unmap=0,latency_stddev_unmap=0,oio=24,unmap_congestion=0,latency_stddev_read=955,iops=10278,read_count=2137263,write_congestion=0,num_oio=76002808 1692384600000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter throughput_unmap=0,congestion=0,iops_unmap=0,client_cache_hit_rate=5,num_oio=78065896,latency_avg=1614,latency_avg_write=3932,throughput=195415408,latency_avg_read=835,iops=10455,iops_write=2629,write_count=789048,read_congestion=0,latency_max_read=459288,latency_avg_unmap=0,unmap_congestion=0,io_count=3137296,iops_read=7825,latency_stddev_write=4795,latency_stddev_unmap=0,write_congestion=0,oio=24,throughput_read=180556256,client_cache_hits=460,latency_max_write=165389,unmap_count=0,latency_max_unmap=0,latency_stddev_read=1299,latency_stddev=2975,read_count=2348248,throughput_write=14859159 1692384900000000000
vsphere_vsan_performance_hostdomclient,clustername=STL_Cloud_02,dcname=St\ Louis,host=0125164ff35e,hostname=hostname,moid=domain-c13,source=STL_Cloud_02,t-collector=watchman-telegraf-lab,vcenter=vcenter throughput=8489920,throughput_read=4677444,latency_avg_write=2768,read_congestion=0,write_congestion=0,io_count=184298,congestion=0,throughput_unmap=0,unmap_count=0,latency_stddev_write=14055,read_count=101171,iops_unmap=0,unmap_congestion=0,latency_stddev_unmap=0,oio=7,iops_read=337,write_count=83127,latency_max_write=1213566,latency_max_unmap=0,latency_max_read=109682,latency_stddev=9538,throughput_write=3812476,client_cache_hit_rate=82,num_oio=1417998,iops=614,latency_avg_read=212,iops_write=277,latency_stddev_read=692,latency_avg=1365,client_cache_hits=252,latency_avg_unmap=0 1692384300000000000
powersj commented 1 year ago

@vdudejon can you try the same process with the artifact in https://github.com/influxdata/telegraf/pull/13795 and return the logs please?

This just adds a few log messages to help me understand what is going on.

Currently, the vsan will loop through the various clusters and launch a collection for each cluster. This however is limited by CollectConcurrency, which you do have set to 5.

I want to see when each launch starts and end, as well as what the timestamps are getting set to as they may not be directly related to when the collection cycle takes place.

Thanks!

vdudejon commented 1 year ago

I think I did this right, please let me know if this is not what you need:

[metrics] start STL_Cloud_01 @ 1692402675
[metrics] start STL_Cloud_01 @ 1692402675
[metrics] start STL_Cloud_01 @ 1692402675
[metrics] start STL_Cloud_01 @ 1692402675
[metrics] start STL_Cloud_01 @ 1692402675
[metrics] end STL_Cloud_01 @ 1692402680
[metrics] start STL_Cloud_01 @ 1692402680
[metrics] end STL_Cloud_01 @ 1692402680
[metrics] start STL_Cloud_01 @ 1692402680
[metrics] end STL_Cloud_01 @ 1692402680
[metrics] end STL_Cloud_01 @ 1692402680
[metrics] end STL_Cloud_01 @ 1692402680
[metrics] end STL_Cloud_01 @ 1692402682
[metrics] end STL_Cloud_01 @ 1692402682
[metrics] start STL_Cloud_06 @ 1692402697
[metrics] start STL_Cloud_06 @ 1692402697
[metrics] start STL_Cloud_06 @ 1692402697
[metrics] start STL_Cloud_06 @ 1692402697
[metrics] start STL_Cloud_06 @ 1692402697
[metrics] end STL_Cloud_06 @ 1692402701
[metrics] start STL_Cloud_06 @ 1692402701
[metrics] end STL_Cloud_06 @ 1692402701
[metrics] start STL_Cloud_06 @ 1692402701
[metrics] end STL_Cloud_06 @ 1692402701
[metrics] end STL_Cloud_06 @ 1692402701
[metrics] end STL_Cloud_06 @ 1692402701
[metrics] end STL_Cloud_06 @ 1692402705
[metrics] end STL_Cloud_06 @ 1692402705
[metrics] start STL_Cloud_01 @ 1692402715
[metrics] start STL_Cloud_01 @ 1692402715
[metrics] start STL_Cloud_01 @ 1692402715
[metrics] start STL_Cloud_01 @ 1692402715
[metrics] start STL_Cloud_01 @ 1692402715
[metrics] end STL_Cloud_01 @ 1692402720
[metrics] start STL_Cloud_01 @ 1692402720
[metrics] end STL_Cloud_01 @ 1692402720
[metrics] start STL_Cloud_01 @ 1692402720
[metrics] end STL_Cloud_01 @ 1692402720
[metrics] end STL_Cloud_01 @ 1692402720
[metrics] end STL_Cloud_01 @ 1692402720
[metrics] end STL_Cloud_01 @ 1692402722
[metrics] end STL_Cloud_01 @ 1692402722
[metrics] start STL_Cloud_05 @ 1692402735
[metrics] start STL_Cloud_05 @ 1692402735
[metrics] start STL_Cloud_05 @ 1692402735
[metrics] start STL_Cloud_05 @ 1692402735
[metrics] start STL_Cloud_05 @ 1692402735
[metrics] end STL_Cloud_05 @ 1692402738
[metrics] start STL_Cloud_05 @ 1692402738
[metrics] end STL_Cloud_05 @ 1692402738
[metrics] start STL_Cloud_05 @ 1692402738
[metrics] end STL_Cloud_05 @ 1692402738
[metrics] end STL_Cloud_05 @ 1692402738
[metrics] end STL_Cloud_05 @ 1692402738
[metrics] end STL_Cloud_05 @ 1692402740
[metrics] end STL_Cloud_05 @ 1692402740
[metrics] start STL_Cloud_01 @ 1692402756
[metrics] start STL_Cloud_01 @ 1692402756
[metrics] start STL_Cloud_01 @ 1692402756
[metrics] start STL_Cloud_01 @ 1692402756
[metrics] start STL_Cloud_01 @ 1692402756
[metrics] end STL_Cloud_01 @ 1692402760
[metrics] start STL_Cloud_01 @ 1692402760
[metrics] end STL_Cloud_01 @ 1692402760
[metrics] start STL_Cloud_01 @ 1692402760
[metrics] end STL_Cloud_01 @ 1692402760
[metrics] end STL_Cloud_01 @ 1692402760
[metrics] end STL_Cloud_01 @ 1692402760
[metrics] end STL_Cloud_01 @ 1692402764
[metrics] end STL_Cloud_01 @ 1692402764
[metrics] start STL_Cloud_01 @ 1692402780
[metrics] start STL_Cloud_01 @ 1692402780
[metrics] start STL_Cloud_01 @ 1692402780
[metrics] start STL_Cloud_01 @ 1692402780
[metrics] start STL_Cloud_01 @ 1692402780
[metrics] end STL_Cloud_01 @ 1692402787
[metrics] start STL_Cloud_01 @ 1692402787
[metrics] end STL_Cloud_01 @ 1692402787
[metrics] start STL_Cloud_01 @ 1692402787
[metrics] end STL_Cloud_01 @ 1692402787
[metrics] end STL_Cloud_01 @ 1692402787
[metrics] end STL_Cloud_01 @ 1692402787
[metrics] end STL_Cloud_01 @ 1692402789
[metrics] end STL_Cloud_01 @ 1692402789
[metrics] start STL_Cloud_01 @ 1692402793
[metrics] start STL_Cloud_01 @ 1692402793
[metrics] start STL_Cloud_01 @ 1692402793
[metrics] start STL_Cloud_01 @ 1692402793
[metrics] start STL_Cloud_01 @ 1692402793
[metrics] end STL_Cloud_01 @ 1692402797
[metrics] start STL_Cloud_01 @ 1692402797
[metrics] end STL_Cloud_01 @ 1692402797
[metrics] start STL_Cloud_01 @ 1692402797
[metrics] end STL_Cloud_01 @ 1692402797
[metrics] end STL_Cloud_01 @ 1692402797
[metrics] end STL_Cloud_01 @ 1692402797
[metrics] end STL_Cloud_01 @ 1692402799
[metrics] end STL_Cloud_01 @ 1692402799
[metrics] start STL_Cloud_04 @ 1692402814
[metrics] start STL_Cloud_04 @ 1692402814
[metrics] start STL_Cloud_04 @ 1692402814
[metrics] start STL_Cloud_04 @ 1692402814
[metrics] start STL_Cloud_04 @ 1692402814
[metrics] end STL_Cloud_04 @ 1692402822
[metrics] start STL_Cloud_04 @ 1692402822
[metrics] end STL_Cloud_04 @ 1692402822
[metrics] start STL_Cloud_04 @ 1692402822
[metrics] end STL_Cloud_04 @ 1692402822
[metrics] end STL_Cloud_04 @ 1692402822
[metrics] end STL_Cloud_04 @ 1692402822
[metrics] end STL_Cloud_04 @ 1692402824
[metrics] end STL_Cloud_04 @ 1692402824
powersj commented 1 year ago

Based on that output, the plugin is capturing one metric per cluster at a time. Hence why it looks like it is doing on cluster at a time. This does not seem right, I would have assumed it would have been all the metrics you requested per cluster.

I can try looking at this, but it would be great if @gangadharaswamy could explain what the intended behavior was.

powersj commented 1 year ago

@vdudejon,

I have updated the PR with some more debug output. New artifacts will be available in 20-30mins.

Could you please provide the full logs this time as well? If you do not want to put them on GitHub, then please email me directly at jpowers at influxdata dot com

Thanks!

vdudejon commented 1 year ago

Thank you, I have emailed them as requested.

powersj commented 1 year ago

@prydin - do you have access to a vsan? The vsan addition to vsphere plugin is randomly picking what vsan it picks from and it is not collecting all metrics from all vsan.

@vdudejon has been very kind in providing me with logs while I guess and check what is going on, but to properly solve this it would be much faster to have access to a vsan. I did look at the govmomi project and it did not look like I could create a simulated vsan, but did not find anything there. Is there something else I might use?

Muy69 commented 1 year ago

@powersj I have access to a vsan esa Cluster and an attached HCI Mesh Cluster .

nem1989 commented 11 months ago

I was able to workaround this by adding a separate input for each cluster limiting it by vsan_cluster_include = ["/DCNAME/host/CLUSTERNAME*"]