search

criteo / graphite-remote-adapter

Fully featured graphite remote adapter for Prometheus
Apache License 2.0
38 stars 25 forks source link

Error parsing metric issue due to invalid segment #83

Open fpytloun opened 3 years ago

fpytloun commented 3 years ago

Running in Kubernetes environment, I am facing following issue. It's probably caused by weird characters in metric names:

22/05/2021 11:01:29 :: [console] Error parsing metric prometheus.prometheus_rule_group_last_evaluation_samples.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fcontainers%2Erules;ContainersGroup: Cannot parse path prometheus.prometheus_rule_group_last_evaluation_samples.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fcontainers%2Erules;ContainersGroup, invalid segment ContainersGroup
22/05/2021 11:01:29 :: [console] Error parsing metric prometheus.prometheus_rule_group_last_evaluation_samples.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fprometheus%2Erules;PrometheusGroup: Cannot parse path prometheus.prometheus_rule_group_last_evaluation_samples.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fprometheus%2Erules;PrometheusGroup, invalid segment PrometheusGroup
22/05/2021 11:01:29 :: [console] Error parsing metric prometheus.prometheus_rule_group_last_evaluation_timestamp_seconds.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fkubernetes%2Erules;KubernetesGroup: Cannot parse path prometheus.prometheus_rule_group_last_evaluation_timestamp_seconds.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fkubernetes%2Erules;KubernetesGroup, invalid segment KubernetesGroup
22/05/2021 11:01:29 :: [console] Error parsing metric prometheus.prometheus_rule_group_last_evaluation_timestamp_seconds.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fnode%2Erules;NodeGroup: Cannot parse path prometheus.prometheus_rule_group_last_evaluation_timestamp_seconds.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fnode%2Erules;NodeGroup, invalid segment NodeGroup
22/05/2021 11:01:29 :: [console] Error parsing metric prometheus.prometheus_rule_group_rules.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fcontainers%2Erules;ContainersGroup: Cannot parse path prometheus.prometheus_rule_group_rules.app.prometheus.cluster_name.domecek.component.core.instance.10%2E244%2E0%2E86:9090.job.kubernetes-pods.kubernetes_namespace.monitoring.kubernetes_pod_name.prometheus-5b6dc9b498-rkspq.pod_template_hash.5b6dc9b498.rule_group.%2Fetc%2Fprometheus-rules%2Fcontainers%2Erules;ContainersGroup, invalid segment ContainersGroup