jirwin / burrow_exporter

Prometheus exporter for burrow
Apache License 2.0
78 stars 68 forks source link

/metrics only showing go stats #25

Closed peterolivo closed 5 years ago

peterolivo commented 5 years ago

This may be a gap of usage knowledge on my end but I am only getting go stats form /metrics Is there a sub URL that I am missing? Burrow is working and, I am not seeing any errors with connecting via docker.

Burrow ouput { "error": false, "message": "cluster list returned", "clusters": [ "local" ], "request": { "url": "/v3/kafka", "host": "70fb55e70e02" } }

/metrics output

# HELP go_gc_duration_seconds A summary of the GC invocation durations.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 0.0003077
go_gc_duration_seconds{quantile="0.25"} 0.0003077
go_gc_duration_seconds{quantile="0.5"} 0.0003139
go_gc_duration_seconds{quantile="0.75"} 0.0003139
go_gc_duration_seconds{quantile="1"} 0.0003139
go_gc_duration_seconds_sum 0.0006216
go_gc_duration_seconds_count 2
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 15
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 437784
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 5.018448e+06
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.444015e+06
# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 15182
# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
# TYPE go_memstats_gc_cpu_fraction gauge
go_memstats_gc_cpu_fraction 9.598504609245178e-07
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 2.371584e+06
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 437784
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 6.4847872e+07
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 1.572864e+06
# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 2168
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 0
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 6.6420736e+07
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.5433399375312576e+09
# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0
# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 17350
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 6912
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 16384
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 30248
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 49152
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 4.194304e+06
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 1.294409e+06
# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 688128
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 688128
# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 7.2284408e+07
# HELP go_threads Number of OS threads created
# TYPE go_threads gauge
go_threads 13
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 0.31
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 1.048576e+06
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 7
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 1.1558912e+07
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.54333909606e+09
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 1.15638272e+08
peterolivo commented 5 years ago

Looks like this is related to not being able to connect to the docker-compose burrow.

burrow_exporter docker logs

time="2018-11-27T18:00:45Z" level=info msg="Scraping burrow..." timestamp=1543341645352244400
time="2018-11-27T18:00:45Z" level=error msg="error making request" endpoint="http://localhost:8000/v3/kafka" err="Get http://localhost:8000/v3/kafka: dial tcp 127.0.0.1:8000: connect: connection refused"
time="2018-11-27T18:00:45Z" level=error msg="error retrieving cluster details" err="Get http://localhost:8000/v3/kafka: dial tcp 127.0.0.1:8000: connect: connection refused"
time="2018-11-27T18:00:45Z" level=error msg="error listing clusters. Continuing." err="Get http://localhost:8000/v3/kafka: dial tcp 127.0.0.1:8000: connect: connection refused"
peterolivo commented 5 years ago

Yep, when configured correctly I get the good stuff

# HELP kafka_burrow_topic_partition_offset The latest offset on a topic's partition as reported by burrow.
# TYPE kafka_burrow_topic_partition_offset gauge
kafka_burrow_topic_partition_offset{cluster="local",partition="0",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="0",topic="test-topic"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="0",topic="test-topic2"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="0",topic="test-topic3"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="1",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="1",topic="test-topic"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="10",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="11",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="12",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="13",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="14",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="15",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="16",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="17",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="18",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="19",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="2",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="20",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="21",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="22",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="23",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="24",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="25",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="26",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="27",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="28",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="29",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="3",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="30",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="31",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="32",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="33",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="34",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="35",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="36",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="37",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="38",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="39",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="4",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="40",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="41",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="42",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="43",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="44",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="45",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="46",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="47",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="48",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="49",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="5",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="6",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="7",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="8",topic="__consumer_offsets"} 0
kafka_burrow_topic_partition_offset{cluster="local",partition="9",topic="__consumer_offsets"} 0

Closing this, maybe it will help others in the future.

9arthi9an commented 5 years ago

@peterolivo Can you please mention, how did you resolve by changing the configuration ?

I'm getting the same issue, but my burrow_exporter logs says, "finished scraping burrow."