kepler node_package does not equal total of kepler_process_package

sustainable-computing-io / kepler

Kepler (Kubernetes-based Efficient Power Level Exporter) uses eBPF to probe performance counters and other system stats, use ML models to estimate workload energy consumption based on these stats, and exports them as Prometheus metrics

https://sustainable-computing.io

Apache License 2.0

1.18k stars 184 forks source link

kepler node_package does not equal total of kepler_process_package #1837

Open sthaha opened 2 weeks ago

sthaha commented 2 weeks ago

Steps to reproduce on a Baremetal

deploy kepler
curl /metrics
grep for node_package_joules
grep for kepler_process_package_joules
sum the values of process
see if the total is different to node_package

Expected: there shouldn't be any significant difference Actual: The difference quite large and grows over time

Using Prometheus

kepler_node_package_joules_total{job="metal"} - on() sum(kepler_process_package_joules_total{job="metal"})

marvin-steinke commented 2 weeks ago

do you think this is related to #1833 ?