### Describe the question/issue
I'm trying to collect metrics from Spring Actuator (io.micrometer) and I'm getting error on output:
**stdout**: could not process metrics payload
**prometheus_remote_write**: Error decoding msgpack encoded context
#### BTW: Using the same configuration but using fluentbit image(cr.fluentbit.io/fluent/fluent-bit:2.2) it just working fine as expected
### Configuration
To test and validate I'm using a docker file and running the application on localhost
This is the docker file:
```
version: "3.8"
services:
fluentbit:
image: public.ecr.aws/aws-observability/aws-for-fluent-bit:init-latest
volumes:
- "//c/Tools/fluentbit/confs:/confs"
environment:
- FLB_LOG_LEVEL=debug
- aws_fluent_bit_init_file_1=/confs/prom_json.conf
- aws_fluent_bit_init_file_2=/fluent-bit/configs/parse-json.conf
ports:
- 2020:2020
```
this is my "extra" conf file:
```
[INPUT]
name prometheus_scrape
host host.docker.internal
port 8082
Tag prom
metrics_path /monitor/prometheus
scrape_interval 10s
[OUTPUT]
Name stdout
Match prom
[OUTPUT]
Name prometheus_remote_write
Match prom
Host mimir_host
Port 443
http_user
http_passwd
Uri /api/v1/push
Header
Log_response_payload True
Tls on
Tls.verify on
```
Fluent Bit Log Output
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=warning msg="[FluentBit Init Process] Unable to get ECS Metadata, ignore this warning if not running on ECS"
fluentbit-fluentbit-1 | Fluent Bit v1.9.10
fluentbit-fluentbit-1 | * Copyright (C) 2015-2022 The Fluent Bit Authors
fluentbit-fluentbit-1 | * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
fluentbit-fluentbit-1 | * https://fluentbit.io
fluentbit-fluentbit-1 |
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] Configuration:
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] flush time | 1.000000 seconds
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] grace | 30 seconds
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] daemon | 0
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] ___________
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] inputs:
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] forward
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] prometheus_scrape
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] ___________
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] filters:
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] parser.0
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] ___________
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] outputs:
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] cloudwatch.0
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] stdout.1
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] prometheus_remote_write.2
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] ___________
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] collectors:
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [fluent bit] version=1.9.10, commit=6af3f19321, pid=1
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [engine] coroutine stack size: 24576 bytes (24.0K)
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [storage] version=1.4.0, type=memory-only, sync=normal, checksum=disabled, max_chunks_up=128
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [cmetrics] version=0.3.7
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [forward:forward.0] created event channels: read=27 write=28
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [in_fw] Listen='0.0.0.0' TCP_Port=24224
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [input:forward:forward.0] listening on 0.0.0.0:24224
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [prometheus_scrape:prometheus_scrape.1] created event channels: read=30 write=31
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [cloudwatch:cloudwatch.0] created event channels: read=32 write=33
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=debug msg="A new higher performance CloudWatch Logs plugin has been released; you are using the old plugin. Check out the new plugin's documentation and determine if you can migrate.\nhttps://docs.fluentbit.io/manual/pipeline/outputs/cloudwatch" func="main.FLBPluginInit()" file="fluent-bit-cloudwatch.go:150"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_group_name = 'fluent-bit-cloudwatch'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:72"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter default_log_group_name = 'fluentbit-default'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:79"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_stream_prefix = 'from-fluent-bit-'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:82"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_stream_name = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:85"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter default_log_stream_name = '/fluentbit-default'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:92"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter region = 'us-east-1'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:95"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_key = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:98"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter role_arn = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:101"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter auto_create_group = 'true'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:104"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter auto_create_stream = 'true'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:107"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter new_log_group_tags = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:110"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_retention_days = '0'" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:113"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter endpoint = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:116"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter sts_endpoint = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:119"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter external_id = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:122"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter credentials_endpoint = " func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:125"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=info msg="[cloudwatch 0] plugin parameter log_format = ''" func="main.getConfiguration()" file="fluent-bit-cloudwatch.go:128"
fluentbit-fluentbit-1 | time="2023-12-08T05:21:01Z" level=debug msg="[cloudwatch 0] Initializing NewOutputPlugin" func="github.com/aws/amazon-cloudwatch-logs-for-fluent-bit/cloudwatch.NewOutputPlugin()" file="cloudwatch.go:196"
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [stdout:stdout.1] created event channels: read=34 write=35
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [prometheus_remote_write:prometheus_remote_write.2] created event channels: read=41 write=42
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [output:stdout:stdout.1] worker #0 started
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [output:prometheus_remote_write:prometheus_remote_write.2] worker #0 started
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [router] match rule forward.0:cloudwatch.0
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [router] data generated by prometheus_scrape.1 input are metrics, but matching destination plugin cloudwatch.0 don't handle metrics.Skipping destination.
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [router] match rule prometheus_scrape.1:stdout.1
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [debug] [router] match rule prometheus_scrape.1:prometheus_remote_write.2
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [sp] stream processor started
fluentbit-fluentbit-1 | [2023/12/08 05:21:01] [ info] [output:prometheus_remote_write:prometheus_remote_write.2] worker #1 started
fluentbit-fluentbit-1 | [2023/12/08 05:21:10] [debug] [http_client] not using http_proxy for header
fluentbit-fluentbit-1 | [2023/12/08 05:21:10] [debug] [input chunk] update output instances with new chunk size diff=28611, records=1, input=prometheus_scrape.1
fluentbit-fluentbit-1 | [2023/12/08 05:21:10] [debug] [upstream] KA connection #69 to host.docker.internal:8082 is now available
fluentbit-fluentbit-1 | [2023/12/08 05:21:10] [debug] [input coro] destroy coro_id=0
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [task] created task=0x7f8d706da2c0 id=0 OK
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [output:stdout:stdout.1] task_id=0 assigned to thread #0
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [output:prometheus_remote_write:prometheus_remote_write.2] task_id=0 assigned to thread #0
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [output:prometheus_remote_write:prometheus_remote_write.2] cmetrics msgpack size: 28611
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [error] [output:stdout:stdout.1] could not process metrics payload
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [out flush] cb_destroy coro_id=0
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [error] [output:prometheus_remote_write:prometheus_remote_write.2] Error decoding msgpack encoded context
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [out flush] cb_destroy coro_id=0
fluentbit-fluentbit-1 | [2023/12/08 05:21:11] [debug] [task] destroy task=0x7f8d706da2c0 (task_id=0)
fluentbit-fluentbit-1 | [2023/12/08 05:21:20] [debug] [upstream] KA connection #69 to host.docker.internal:8082 has been assigned (recycled)
fluentbit-fluentbit-1 | [2023/12/08 05:21:20] [debug] [http_client] not using http_proxy for header
fluentbit-fluentbit-1 | [2023/12/08 05:21:20] [debug] [input chunk] update output instances with new chunk size diff=28611, records=1, input=prometheus_scrape.1
fluentbit-fluentbit-1 | [2023/12/08 05:21:20] [debug] [upstream] KA connection #69 to host.docker.internal:8082 is now available
fluentbit-fluentbit-1 | [2023/12/08 05:21:20] [debug] [input coro] destroy coro_id=1
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [task] created task=0x7f8d706d8810 id=0 OK
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [output:stdout:stdout.1] task_id=0 assigned to thread #0
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [output:prometheus_remote_write:prometheus_remote_write.2] task_id=0 assigned to thread #1
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [output:prometheus_remote_write:prometheus_remote_write.2] cmetrics msgpack size: 28611
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [error] [output:stdout:stdout.1] could not process metrics payload
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [out flush] cb_destroy coro_id=1
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [error] [output:prometheus_remote_write:prometheus_remote_write.2] Error decoding msgpack encoded context
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [out flush] cb_destroy coro_id=0
fluentbit-fluentbit-1 | [2023/12/08 05:21:21] [debug] [task] destroy task=0x7f8d706d8810 (task_id=0)
fluentbit-fluentbit-1 | [2023/12/08 05:21:30] [debug] [upstream] KA connection #69 to host.docker.internal:8082 has been assigned (recycled)
fluentbit-fluentbit-1 | [2023/12/08 05:21:30] [debug] [http_client] not using http_proxy for header
fluentbit-fluentbit-1 | [2023/12/08 05:21:30] [debug] [input chunk] update output instances with new chunk size diff=28611, records=1, input=prometheus_scrape.1
fluentbit-fluentbit-1 | [2023/12/08 05:21:30] [debug] [upstream] KA connection #69 to host.docker.internal:8082 is now available
fluentbit-fluentbit-1 | [2023/12/08 05:21:30] [debug] [input coro] destroy coro_id=2
Gracefully stopping... (press Ctrl+C again to force)
Aborting on container exit...
Fluent Bit Version Info
Cluster Details
Application Details
Spring Actuator Data Sample:
# HELP jvm_gc_memory_allocated_bytes_total Incremented for an increase in the size of the (young) heap memory pool after one GC to before the next
# TYPE jvm_gc_memory_allocated_bytes_total counter
jvm_gc_memory_allocated_bytes_total 1.17440512E8
# HELP spring_security_filterchains_RequestCacheAwareFilter_after_total
# TYPE spring_security_filterchains_RequestCacheAwareFilter_after_total counter
spring_security_filterchains_RequestCacheAwareFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP jvm_threads_daemon_threads The current number of live daemon threads
# TYPE jvm_threads_daemon_threads gauge
jvm_threads_daemon_threads 40.0
# HELP logback_events_total Number of log events that were enabled by the effective log level
# TYPE logback_events_total counter
logback_events_total{level="warn",} 1.0
logback_events_total{level="debug",} 0.0
logback_events_total{level="error",} 0.0
logback_events_total{level="trace",} 0.0
logback_events_total{level="info",} 6.0
# HELP http_server_requests_active_seconds_max
# TYPE http_server_requests_active_seconds_max gauge
http_server_requests_active_seconds_max{exception="none",method="GET",outcome="SUCCESS",status="200",uri="UNKNOWN",} 0.0027311
# HELP http_server_requests_active_seconds
# TYPE http_server_requests_active_seconds summary
http_server_requests_active_seconds_active_count{exception="none",method="GET",outcome="SUCCESS",status="200",uri="UNKNOWN",} 1.0
http_server_requests_active_seconds_duration_sum{exception="none",method="GET",outcome="SUCCESS",status="200",uri="UNKNOWN",} 0.002721
# HELP jvm_gc_live_data_size_bytes Size of long-lived heap memory pool after reclamation
# TYPE jvm_gc_live_data_size_bytes gauge
jvm_gc_live_data_size_bytes 0.0
# HELP jvm_gc_overhead_percent An approximation of the percent of CPU time used by GC activities over the last lookback period or since monitoring began, whichever is shorter, in the range [0..1]
# TYPE jvm_gc_overhead_percent gauge
jvm_gc_overhead_percent 0.0
# HELP jvm_buffer_total_capacity_bytes An estimate of the total capacity of the buffers in this pool
# TYPE jvm_buffer_total_capacity_bytes gauge
jvm_buffer_total_capacity_bytes{id="mapped - 'non-volatile memory'",} 0.0
jvm_buffer_total_capacity_bytes{id="mapped",} 0.0
jvm_buffer_total_capacity_bytes{id="direct",} 117803.0
# HELP spring_security_filterchains_CsrfFilter_after_total
# TYPE spring_security_filterchains_CsrfFilter_after_total counter
spring_security_filterchains_CsrfFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP tomcat_sessions_expired_sessions_total
# TYPE tomcat_sessions_expired_sessions_total counter
tomcat_sessions_expired_sessions_total 0.0
# HELP spring_security_http_secured_requests_seconds
# TYPE spring_security_http_secured_requests_seconds summary
spring_security_http_secured_requests_seconds_count{error="none",} 33.0
spring_security_http_secured_requests_seconds_sum{error="none",} 1.852014001
# HELP spring_security_http_secured_requests_seconds_max
# TYPE spring_security_http_secured_requests_seconds_max gauge
spring_security_http_secured_requests_seconds_max{error="none",} 0.0373014
# HELP spring_security_filterchains_ExceptionTranslationFilter_after_total
# TYPE spring_security_filterchains_ExceptionTranslationFilter_after_total counter
spring_security_filterchains_ExceptionTranslationFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP spring_security_filterchains_HeaderWriterFilter_before_total
# TYPE spring_security_filterchains_HeaderWriterFilter_before_total counter
spring_security_filterchains_HeaderWriterFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP executor_active_threads The approximate number of threads that are actively executing tasks
# TYPE executor_active_threads gauge
executor_active_threads{name="applicationTaskExecutor",} 0.0
# HELP http_server_requests_seconds
# TYPE http_server_requests_seconds summary
http_server_requests_seconds_count{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="404",uri="NOT_FOUND",} 1.0
http_server_requests_seconds_sum{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="404",uri="NOT_FOUND",} 0.003796701
http_server_requests_seconds_count{error="none",exception="none",method="GET",outcome="SUCCESS",status="200",uri="/monitor/prometheus",} 32.0
http_server_requests_seconds_sum{error="none",exception="none",method="GET",outcome="SUCCESS",status="200",uri="/monitor/prometheus",} 1.9300149
http_server_requests_seconds_count{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="401",uri="UNKNOWN",} 2.0
http_server_requests_seconds_sum{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="401",uri="UNKNOWN",} 0.0037019
# HELP http_server_requests_seconds_max
# TYPE http_server_requests_seconds_max gauge
http_server_requests_seconds_max{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="404",uri="NOT_FOUND",} 0.003796701
http_server_requests_seconds_max{error="none",exception="none",method="GET",outcome="SUCCESS",status="200",uri="/monitor/prometheus",} 0.0381094
http_server_requests_seconds_max{error="none",exception="none",method="GET",outcome="CLIENT_ERROR",status="401",uri="UNKNOWN",} 0.002997
# HELP spring_security_filterchains_BearerTokenAuthenticationFilter_before_total
# TYPE spring_security_filterchains_BearerTokenAuthenticationFilter_before_total counter
spring_security_filterchains_BearerTokenAuthenticationFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP jvm_classes_loaded_classes The number of classes that are currently loaded in the Java virtual machine
# TYPE jvm_classes_loaded_classes gauge
jvm_classes_loaded_classes 18407.0
# HELP executor_queue_remaining_tasks The number of additional elements that this queue can ideally accept without blocking
# TYPE executor_queue_remaining_tasks gauge
executor_queue_remaining_tasks{name="applicationTaskExecutor",} 2.147483647E9
# HELP spring_security_filterchains_AnonymousAuthenticationFilter_after_total
# TYPE spring_security_filterchains_AnonymousAuthenticationFilter_after_total counter
spring_security_filterchains_AnonymousAuthenticationFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP tomcat_sessions_rejected_sessions_total
# TYPE tomcat_sessions_rejected_sessions_total counter
tomcat_sessions_rejected_sessions_total 0.0
# HELP process_start_time_seconds Start time of the process since unix epoch.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.702012349248E9
# HELP spring_security_filterchains_WebAsyncManagerIntegrationFilter_after_total
# TYPE spring_security_filterchains_WebAsyncManagerIntegrationFilter_after_total counter
spring_security_filterchains_WebAsyncManagerIntegrationFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP jvm_buffer_count_buffers An estimate of the number of buffers in the pool
# TYPE jvm_buffer_count_buffers gauge
jvm_buffer_count_buffers{id="mapped - 'non-volatile memory'",} 0.0
jvm_buffer_count_buffers{id="mapped",} 0.0
jvm_buffer_count_buffers{id="direct",} 50.0
# HELP spring_security_filterchains_RequestCacheAwareFilter_before_total
# TYPE spring_security_filterchains_RequestCacheAwareFilter_before_total counter
spring_security_filterchains_RequestCacheAwareFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP executor_pool_size_threads The current number of threads in the pool
# TYPE executor_pool_size_threads gauge
executor_pool_size_threads{name="applicationTaskExecutor",} 0.0
# HELP spring_security_filterchains_WebAsyncManagerIntegrationFilter_before_total
# TYPE spring_security_filterchains_WebAsyncManagerIntegrationFilter_before_total counter
spring_security_filterchains_WebAsyncManagerIntegrationFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP spring_security_filterchains_SecurityContextHolderAwareRequestFilter_after_total
# TYPE spring_security_filterchains_SecurityContextHolderAwareRequestFilter_after_total counter
spring_security_filterchains_SecurityContextHolderAwareRequestFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP spring_security_filterchains_LogoutFilter_before_total
# TYPE spring_security_filterchains_LogoutFilter_before_total counter
spring_security_filterchains_LogoutFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP jvm_info JVM version info
# TYPE jvm_info gauge
jvm_info{runtime="OpenJDK Runtime Environment",vendor="Amazon.com Inc.",version="17.0.2+8-LTS",} 1.0
# HELP jvm_compilation_time_ms_total The approximate accumulated elapsed time spent in compilation
# TYPE jvm_compilation_time_ms_total counter
jvm_compilation_time_ms_total{compiler="HotSpot 64-Bit Tiered Compilers",} 2971.0
# HELP spring_security_filterchains_BearerTokenAuthenticationFilter_after_total
# TYPE spring_security_filterchains_BearerTokenAuthenticationFilter_after_total counter
spring_security_filterchains_BearerTokenAuthenticationFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP jvm_gc_max_data_size_bytes Max size of long-lived heap memory pool
# TYPE jvm_gc_max_data_size_bytes gauge
jvm_gc_max_data_size_bytes 8.413773824E9
# HELP jvm_threads_states_threads The current number of threads
# TYPE jvm_threads_states_threads gauge
jvm_threads_states_threads{state="runnable",} 25.0
jvm_threads_states_threads{state="blocked",} 0.0
jvm_threads_states_threads{state="waiting",} 12.0
jvm_threads_states_threads{state="timed-waiting",} 7.0
jvm_threads_states_threads{state="new",} 0.0
jvm_threads_states_threads{state="terminated",} 0.0
# HELP jvm_memory_used_bytes The amount of used memory
# TYPE jvm_memory_used_bytes gauge
jvm_memory_used_bytes{area="heap",id="G1 Survivor Space",} 7488064.0
jvm_memory_used_bytes{area="heap",id="G1 Old Gen",} 3.9491072E7
jvm_memory_used_bytes{area="nonheap",id="Metaspace",} 8.1859216E7
jvm_memory_used_bytes{area="nonheap",id="CodeCache",} 1.8332928E7
jvm_memory_used_bytes{area="heap",id="G1 Eden Space",} 2.5165824E7
jvm_memory_used_bytes{area="nonheap",id="Compressed Class Space",} 1.1427744E7
# HELP tomcat_sessions_alive_max_seconds
# TYPE tomcat_sessions_alive_max_seconds gauge
tomcat_sessions_alive_max_seconds 0.0
# HELP spring_security_filterchains_CsrfFilter_before_total
# TYPE spring_security_filterchains_CsrfFilter_before_total counter
spring_security_filterchains_CsrfFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP spring_security_filterchains_AuthorizationFilter_after_total
# TYPE spring_security_filterchains_AuthorizationFilter_after_total counter
spring_security_filterchains_AuthorizationFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 33.0
# HELP jvm_threads_live_threads The current number of live threads including both daemon and non-daemon threads
# TYPE jvm_threads_live_threads gauge
jvm_threads_live_threads 44.0
# HELP spring_security_filterchains_active_seconds_max
# TYPE spring_security_filterchains_active_seconds_max gauge
spring_security_filterchains_active_seconds_max{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
spring_security_filterchains_active_seconds_max{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
# HELP spring_security_filterchains_active_seconds
# TYPE spring_security_filterchains_active_seconds summary
spring_security_filterchains_active_seconds_active_count{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
spring_security_filterchains_active_seconds_duration_sum{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
spring_security_filterchains_active_seconds_active_count{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
spring_security_filterchains_active_seconds_duration_sum{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 0.0
# HELP executor_pool_max_threads The maximum allowed number of threads in the pool
# TYPE executor_pool_max_threads gauge
executor_pool_max_threads{name="applicationTaskExecutor",} 2.147483647E9
# HELP process_cpu_usage The "recent cpu usage" for the Java Virtual Machine process
# TYPE process_cpu_usage gauge
process_cpu_usage 9.960666162398585E-4
# HELP process_uptime_seconds The uptime of the Java virtual machine
# TYPE process_uptime_seconds gauge
process_uptime_seconds 1243.119
# HELP spring_security_filterchains_SecurityContextHolderFilter_before_total
# TYPE spring_security_filterchains_SecurityContextHolderFilter_before_total counter
spring_security_filterchains_SecurityContextHolderFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP spring_security_filterchains_HeaderWriterFilter_after_total
# TYPE spring_security_filterchains_HeaderWriterFilter_after_total counter
spring_security_filterchains_HeaderWriterFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP jvm_classes_unloaded_classes_total The total number of classes unloaded since the Java virtual machine has started execution
# TYPE jvm_classes_unloaded_classes_total counter
jvm_classes_unloaded_classes_total 0.0
# HELP jvm_memory_usage_after_gc_percent The percentage of long-lived heap pool used after the last GC event, in the range [0..1]
# TYPE jvm_memory_usage_after_gc_percent gauge
jvm_memory_usage_after_gc_percent{area="heap",pool="long-lived",} 0.004693621771404536
# HELP tomcat_sessions_created_sessions_total
# TYPE tomcat_sessions_created_sessions_total counter
tomcat_sessions_created_sessions_total 1.0
# HELP spring_security_filterchains_SecurityContextHolderAwareRequestFilter_before_total
# TYPE spring_security_filterchains_SecurityContextHolderAwareRequestFilter_before_total counter
spring_security_filterchains_SecurityContextHolderAwareRequestFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP spring_security_authorizations_active_seconds_max
# TYPE spring_security_authorizations_active_seconds_max gauge
spring_security_authorizations_active_seconds_max{spring_security_authentication_type="n/a",spring_security_authorization_decision="unknown",spring_security_object="request",} 0.0
# HELP spring_security_authorizations_active_seconds
# TYPE spring_security_authorizations_active_seconds summary
spring_security_authorizations_active_seconds_active_count{spring_security_authentication_type="n/a",spring_security_authorization_decision="unknown",spring_security_object="request",} 0.0
spring_security_authorizations_active_seconds_duration_sum{spring_security_authentication_type="n/a",spring_security_authorization_decision="unknown",spring_security_object="request",} 0.0
# HELP spring_security_filterchains_ExceptionTranslationFilter_before_total
# TYPE spring_security_filterchains_ExceptionTranslationFilter_before_total counter
spring_security_filterchains_ExceptionTranslationFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP tomcat_sessions_active_current_sessions
# TYPE tomcat_sessions_active_current_sessions gauge
tomcat_sessions_active_current_sessions 1.0
# HELP jvm_memory_max_bytes The maximum amount of memory in bytes that can be used for memory management
# TYPE jvm_memory_max_bytes gauge
jvm_memory_max_bytes{area="heap",id="G1 Survivor Space",} -1.0
jvm_memory_max_bytes{area="heap",id="G1 Old Gen",} 8.413773824E9
jvm_memory_max_bytes{area="nonheap",id="Metaspace",} -1.0
jvm_memory_max_bytes{area="nonheap",id="CodeCache",} 5.0331648E7
jvm_memory_max_bytes{area="heap",id="G1 Eden Space",} -1.0
jvm_memory_max_bytes{area="nonheap",id="Compressed Class Space",} 1.073741824E9
# HELP spring_security_filterchains_AuthorizationFilter_before_total
# TYPE spring_security_filterchains_AuthorizationFilter_before_total counter
spring_security_filterchains_AuthorizationFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP jvm_threads_peak_threads The peak live thread count since the Java virtual machine started or peak was reset
# TYPE jvm_threads_peak_threads gauge
jvm_threads_peak_threads 51.0
# HELP jvm_gc_pause_seconds Time spent in GC pause
# TYPE jvm_gc_pause_seconds summary
jvm_gc_pause_seconds_count{action="end of minor GC",cause="G1 Evacuation Pause",} 2.0
jvm_gc_pause_seconds_sum{action="end of minor GC",cause="G1 Evacuation Pause",} 0.016
# HELP jvm_gc_pause_seconds_max Time spent in GC pause
# TYPE jvm_gc_pause_seconds_max gauge
jvm_gc_pause_seconds_max{action="end of minor GC",cause="G1 Evacuation Pause",} 0.0
# HELP jvm_gc_memory_promoted_bytes_total Count of positive increases in the size of the old generation memory pool before GC to after GC
# TYPE jvm_gc_memory_promoted_bytes_total counter
jvm_gc_memory_promoted_bytes_total 268800.0
# HELP system_cpu_count The number of processors available to the Java virtual machine
# TYPE system_cpu_count gauge
system_cpu_count 8.0
# HELP spring_security_filterchains_AnonymousAuthenticationFilter_before_total
# TYPE spring_security_filterchains_AnonymousAuthenticationFilter_before_total counter
spring_security_filterchains_AnonymousAuthenticationFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP executor_pool_core_threads The core number of threads for the pool
# TYPE executor_pool_core_threads gauge
executor_pool_core_threads{name="applicationTaskExecutor",} 8.0
# HELP spring_security_filterchains_SecurityContextHolderFilter_after_total
# TYPE spring_security_filterchains_SecurityContextHolderFilter_after_total counter
spring_security_filterchains_SecurityContextHolderFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP spring_security_filterchains_DisableEncodeUrlFilter_after_total
# TYPE spring_security_filterchains_DisableEncodeUrlFilter_after_total counter
spring_security_filterchains_DisableEncodeUrlFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP spring_security_filterchains_seconds_max
# TYPE spring_security_filterchains_seconds_max gauge
spring_security_filterchains_seconds_max{error="none",security_security_reached_filter_section="before",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="AuthorizationFilter",} 0.0724566
spring_security_filterchains_seconds_max{error="none",security_security_reached_filter_section="after",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="DisableEncodeUrlFilter",} 1.864E-4
# HELP spring_security_filterchains_seconds
# TYPE spring_security_filterchains_seconds summary
spring_security_filterchains_seconds_count{error="none",security_security_reached_filter_section="before",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="AuthorizationFilter",} 37.0
spring_security_filterchains_seconds_sum{error="none",security_security_reached_filter_section="before",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="AuthorizationFilter",} 0.120553201
spring_security_filterchains_seconds_count{error="none",security_security_reached_filter_section="after",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="DisableEncodeUrlFilter",} 36.0
spring_security_filterchains_seconds_sum{error="none",security_security_reached_filter_section="after",spring_security_filterchain_position="12",spring_security_filterchain_size="12",spring_security_reached_filter_name="DisableEncodeUrlFilter",} 0.0123922
# HELP jvm_memory_committed_bytes The amount of memory in bytes that is committed for the Java virtual machine to use
# TYPE jvm_memory_committed_bytes gauge
jvm_memory_committed_bytes{area="heap",id="G1 Survivor Space",} 8388608.0
jvm_memory_committed_bytes{area="heap",id="G1 Old Gen",} 6.7108864E7
jvm_memory_committed_bytes{area="nonheap",id="Metaspace",} 8.257536E7
jvm_memory_committed_bytes{area="nonheap",id="CodeCache",} 1.9791872E7
jvm_memory_committed_bytes{area="heap",id="G1 Eden Space",} 6.7108864E7
jvm_memory_committed_bytes{area="nonheap",id="Compressed Class Space",} 1.179648E7
# HELP tomcat_sessions_active_max_sessions
# TYPE tomcat_sessions_active_max_sessions gauge
tomcat_sessions_active_max_sessions 1.0
# HELP spring_security_filterchains_DisableEncodeUrlFilter_before_total
# TYPE spring_security_filterchains_DisableEncodeUrlFilter_before_total counter
spring_security_filterchains_DisableEncodeUrlFilter_before_total{security_security_reached_filter_section="before",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 37.0
# HELP jvm_buffer_memory_used_bytes An estimate of the memory that the Java virtual machine is using for this buffer pool
# TYPE jvm_buffer_memory_used_bytes gauge
jvm_buffer_memory_used_bytes{id="mapped - 'non-volatile memory'",} 0.0
jvm_buffer_memory_used_bytes{id="mapped",} 0.0
jvm_buffer_memory_used_bytes{id="direct",} 117804.0
# HELP system_cpu_usage The "recent cpu usage" of the system the application is running in
# TYPE system_cpu_usage gauge
system_cpu_usage 0.17445165459417122
# HELP executor_queued_tasks The approximate number of tasks that are queued for execution
# TYPE executor_queued_tasks gauge
executor_queued_tasks{name="applicationTaskExecutor",} 0.0
# HELP executor_completed_tasks_total The approximate total number of tasks that have completed execution
# TYPE executor_completed_tasks_total counter
executor_completed_tasks_total{name="applicationTaskExecutor",} 0.0
# HELP spring_security_http_secured_requests_active_seconds
# TYPE spring_security_http_secured_requests_active_seconds summary
spring_security_http_secured_requests_active_seconds_active_count 1.0
spring_security_http_secured_requests_active_seconds_duration_sum 0.043769801
# HELP spring_security_http_secured_requests_active_seconds_max
# TYPE spring_security_http_secured_requests_active_seconds_max gauge
spring_security_http_secured_requests_active_seconds_max 0.043773701
# HELP spring_security_filterchains_LogoutFilter_after_total
# TYPE spring_security_filterchains_LogoutFilter_after_total counter
spring_security_filterchains_LogoutFilter_after_total{security_security_reached_filter_section="after",spring_security_filterchain_position="0",spring_security_filterchain_size="0",spring_security_reached_filter_name="none",} 36.0
# HELP spring_security_authorizations_seconds
# TYPE spring_security_authorizations_seconds summary
spring_security_authorizations_seconds_count{error="none",spring_security_authentication_type="n/a",spring_security_authorization_decision="true",spring_security_object="request",} 34.0
spring_security_authorizations_seconds_sum{error="none",spring_security_authentication_type="n/a",spring_security_authorization_decision="true",spring_security_object="request",} 0.010791302
spring_security_authorizations_seconds_count{error="AccessDeniedException",spring_security_authentication_type="AnonymousAuthenticationToken",spring_security_authorization_decision="false",spring_security_object="request",} 3.0
spring_security_authorizations_seconds_sum{error="AccessDeniedException",spring_security_authentication_type="AnonymousAuthenticationToken",spring_security_authorization_decision="false",spring_security_object="request",} 8.631E-4
# HELP spring_security_authorizations_seconds_max
# TYPE spring_security_authorizations_seconds_max gauge
spring_security_authorizations_seconds_max{error="none",spring_security_authentication_type="n/a",spring_security_authorization_decision="true",spring_security_object="request",} 1.027E-4
spring_security_authorizations_seconds_max{error="AccessDeniedException",spring_security_authentication_type="AnonymousAuthenticationToken",spring_security_authorization_decision="false",spring_security_object="request",} 6.242E-4
Fluent Bit Log Output
Fluent Bit Version Info
Cluster Details
Application Details
Spring Actuator Data Sample:
Related Issues