search

sexibytes / sexigraf

SexiGraf is a vSphere centric Graphite appliance with a Grafana frontend.
http://www.sexigraf.fr
MIT License
128 stars 21 forks source link

Cluster FullStats: no power usage data #395

Open MrDpy opened 6 months ago

MrDpy commented 6 months ago

Hi,

I have 2 clusters using Dell PowerEdge R650,neither of the 2 clusters shows power usage power_usage_no_data

In vCenter, power usage is available vCenter_power_usage

sexigraf: 0.99j vCenter: 8.0.2 (23319993) VMware ESXi, 8.0.2, 23305546

Thanks in advance

rschitz commented 6 months ago

Hi and thank you for your support. Can you check the logs for any error or warning please?

MrDpy commented 6 months ago

Hi,

ViPullStatistics.log 2024-04-30T22:00:17.4818542+00:00 myVcenter.domain [INFO] Sending cluster, hosts, vms and datastores metrics to Graphite for cluster vsi_cluster ... 2024-04-30T22:00:17.8143572+00:00 myVcenter.domain [INFO] Processing vCenter MyvCenter cluster vdi_cluster in datacenter datacenter1 2024-04-30T22:00:17.8153505+00:00 myVcenter.domain [INFO] Processing vCenter MyvCenter cluster vdi_cluster hosts in datacenter datacenter1 2024-04-30T22:00:17.8221667+00:00 myVcenter.domain [EROR] ESX srv232 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8227688+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8290007+00:00 myVcenter.domain [EROR] ESX srv234 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8296381+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8360548+00:00 myVcenter.domain [EROR] ESX vdisis122 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8366503+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8433131+00:00 myVcenter.domain [EROR] ESX vdisis130 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8439285+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8500684+00:00 myVcenter.domain [EROR] ESX vdisis124 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8507377+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8607616+00:00 myVcenter.domain [EROR] ESX vdisis134 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8613905+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8678848+00:00 myVcenter.domain [EROR] ESX vdisis126 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8686001+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8753515+00:00 myVcenter.domain [EROR] ESX srv224 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8759559+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8821150+00:00 myVcenter.domain [EROR] ESX srv222 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8826867+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8891873+00:00 myVcenter.domain [EROR] ESX vdisis136 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8898794+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.8960624+00:00 myVcenter.domain [EROR] ESX vdisis132 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.8966492+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9035682+00:00 myVcenter.domain [EROR] ESX srv236 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.9042177+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9111017+00:00 myVcenter.domain [EROR] ESX srv226 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.9118215+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9272595+00:00 myVcenter.domain [EROR] ESX vdisis128 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.9281684+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9378019+00:00 myVcenter.domain [EROR] ESX srv230 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.9387022+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9482632+00:00 myVcenter.domain [EROR] ESX srv228 fatstats power metrics issue in cluster vdi_cluster 2024-04-30T22:00:17.9492198+00:00 myVcenter.domain [EROR] Cannot index into a null array. 2024-04-30T22:00:17.9514619+00:00 myVcenter.domain [INFO] Processing vCenter MyvCenter cluster vdi_cluster vms in datacenter datacenter1

is there another log I can check?

MrDpy commented 6 months ago

Hi, I don't know if this helps, but searching in closed issues, I found this issue : https://github.com/sexibytes/sexigraf/issues/342 I ran the commands, and got the same results https://github.com/sexibytes/sexigraf/issues/342#issuecomment-1560097634 https://github.com/sexibytes/sexigraf/issues/342#issuecomment-1576732425

rschitz commented 6 months ago

Interesting, thanks a lot running the commands, i wanted to ask you to do it. I got some Dell servers so I'll try to reproduce your setup, what version of ESX and what image you're running?

MrDpy commented 6 months ago

Dell PowerEdge R650 ESXi Version | 8.0 U2b - 23305546 with Dell addon for PowerEdge Servers 802-A04 vCenter 8.0.2 / Build 23319993

rschitz commented 6 months ago

ok so the addon on top of the stock vmware iso not the dell iso right?

MrDpy commented 6 months ago

Yes, correct The basic installation, in 8.0.1, was made using Dell iso, but updates via the Lifecycle Manager Iit seems to me that I've never seen any data in power usage since I started using these servers.

edit: I have 2x independent Dell R740xd (same esx version) if you want me to try some commands.

rschitz commented 6 months ago

not yet, i'd like to have the same setup as yours first but thanks. can you share the image profile you got: image

MrDpy commented 6 months ago

as requested

cluster_image lifecycle_manager

rschitz commented 6 months ago

Thanks, I'll apply this image

MrDpy commented 6 months ago

If it helps, with this little script, I get the power usage of one of the servers.

Connect-VIServer -server MyvCenter

$entity = Get-VMHost -Name MyServer
$stat = "power.power.average"

Get-Stat -Entity $entity -Stat $stat -Realtime -MaxSamples 1

Value : 555 Timestamp : 02.05.2024 20:38:40 MetricId : power.power.average Unit : watt Description : Current power usage Entity : MyServer EntityId : HostSystem-host-308352 IntervalSecs : 20

rschitz commented 6 months ago

Hi, Thanks for your feed back. Get-stat is a cmdlet which is not very scalable that why we use the object views. As you can see here, we use the same metric id but i believe it is the format returned that is different that's why i'm trying to reproduce your setup

MrDpy commented 6 months ago

Hi, Thanks for the explanation Sorry to force you to reproduce my setup to identify the problem I hope you'll be able to find a solution

rschitz commented 6 months ago

no problem, thank you for your help also. you're not the only one in this case so i need to know why ;)