loft-sh / loft

Namespace & Virtual Cluster Manager for Kubernetes - Lightweight Virtual Clusters, Self-Service Provisioning for Engineers and 70% Cost Savings with Sleep Mode
https://loft.sh/docs/introduction
Other
738 stars 65 forks source link

Error on ingesting samples with different value but same timestamp #266

Open gabriel-suela opened 1 month ago

gabriel-suela commented 1 month ago

Description

I found that vcluster-plataform has some duplicated metrics

image

Logs

image

2024-10-22T18:41:43.517388156Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:41:43.517Z"}
2024-10-22T18:41:58.386917743Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:41:58.386Z"}
2024-10-22T18:42:43.515606831Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:42:43.515Z"}
2024-10-22T18:42:58.388641418Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:42:58.388Z"}
2024-10-22T18:43:43.574038594Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:43:43.573Z"}
2024-10-22T18:43:58.395738347Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:43:58.395Z"}
2024-10-22T18:44:43.531531536Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:44:43.531Z"}
2024-10-22T18:44:58.386246936Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:44:58.386Z"}
2024-10-22T18:45:43.517569606Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:45:43.517Z"}
2024-10-22T18:45:58.390441558Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":40,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.42:8080/metrics","ts":"2024-10-22T18:45:58.390Z"}
2024-10-22T18:47:33.535271703Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:47:33.535Z"}
2024-10-22T18:47:36.061526472Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:47:36.061Z"}
2024-10-22T18:48:33.525743392Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:48:33.525Z"}
2024-10-22T18:48:36.055133437Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:48:36.054Z"}
2024-10-22T18:49:33.554069283Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:49:33.553Z"}
2024-10-22T18:49:36.031169546Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"http://10.44.4.241:8080/metrics","ts":"2024-10-22T18:49:36.030Z"}
2024-10-22T18:50:33.518672453Z prometheus {"caller":"scrape.go:1754","component":"scrape manager","level":"warn","msg":"Error on ingesting samples with different value but same timestamp","num_dropped":44,"scrape_pool":"serviceMonitor/vcluster-platform/loft/0","target":"h

Versions

Kubernetes: 1.30 vcluster-plataform: 4.0.0