search

AXinx / Log2Pro

0 stars 0 forks source link

Retrieve data #6

Open AXinx opened 4 years ago

AXinx commented 4 years ago

Still exist problem when retrieving data

AXinx commented 4 years ago

Really thank you for solving "CORS" bug. But when I tried to retrieve data. There is no data return.

Screenshot 2020-04-02 at 15 52 35

So I printed logs.

Screenshot 2020-04-02 at 23 23 34

The error is "Connection refused", do you have any idea?
Also, I am still confused about the url of dbConnector and the query url. How to do the Prometheus query here?

skoulouzis commented 4 years ago

Cannot reproduce. Please include steps to reproduce and report one issue per report. Here is a guide that may help you with bug reporting. https://www.lucidchart.com/blog/how-to-write-an-effective-bug-report-that-actually-gets-resolved-and-why-everyone-should

AXinx commented 4 years ago

  1. Follow the Procedure in Readme.md. In step 6, then click "visualize data", there is no data return. Like the first picture shown above.

  2. Then print the logs of the prise service. 

    docker stack ps webservice

    Check the ID of webservice_prise

    docker service logs ID

    Will show the error 'ConnectException: Connection refused (Connection refused)' Like the second picture shown above.

skoulouzis commented 4 years ago

I found the error. Steps to reproduce:

  1. sudo ./build.sh. Got back: 
    denied: requested access to the resource is denied
  2. In 'build.sh' I comment the line: 
    sudo docker push xinryxx/prise:latest
  3. Run again 'sudo ./build.sh'
  4. Opened in browser: 'http://localhost:9081/index3.html'
  5. In 'http://localhost:9081/index3.html' upload files: 'docker_workflow/new_workflow.t2flow' 'docker_workflow/workflowrun.prov.ttl'
  6. Pressed 'Parse input' and output is populated: 
    Name    Endpoint    Method  Start-time  End-time
GETIMAGE    http://localhost:8089   GET 2020-3-24 9:33:18.275   2020-3-24 9:33:18.289
EFFECT1 http://localhost:8089/a POST    2020-3-24 9:33:18.293   2020-3-24 9:33:18.331
EFFECT2 http://localhost:8089/b POST    2020-3-24 9:33:18.335   2020-3-24 9:33:18.361
  7. Pressed 'Visulize data' in browser. Expected to see a visulization of the metrics but nothon is shown. Instead on the web console we see: 
    http://localhost:9090/metrics getData.js:5:9
http://localhost:9081 upload.js:58:13
FormData {  }
upload.js:59:13
Synchronous XMLHttpRequest on the main thread is deprecated because of its detrimental effects to the end user’s experience. For more help http://xhr.spec.whatwg.org/ upload.js:61:8
Array(3) [ {…}, {…}, {…} ]
upload.js:81:13
innerHTML: http://localhost:9081 getData.js:12:13
Object { services: (3) […], workflow: {…} }
getData.js:28:13
Array(4) [ "http:", "", "localhost:9081", "index3.html" ]
getData.js:124:13
queryURL=http://localhost:9090/metrics?endpoint=http%3A%2F%2Flocalhost%3A9090&startTime=1585038783&endTime=1585038814 getData.js:128:13
xhr responseText: getData.js:133:13
prm: getData.js:55:21
Array [ "" ]
getData.js:30:13
{} getData.js:38:21
formatData/<@http://localhost:9081/getData.js:89:17
formatData@http://localhost:9081/getData.js:88:26
getData/<@http://localhost:9081/getData.js:39:27
getData.js:42:21
  8. In 'sudo docker service logs -f webservice_prise' we see: 
    webservice_prise.1.i343ddvj1g30@kif    | 2020-04-07 10:49:08.077  INFO 6 --- [nio-9081-exec-5] n.u.s.v.p.c.ProvIntegratorController     : queryURL: http://localhost:9090/metrics?endpoint=http://localhost:9090
webservice_prise.1.i343ddvj1g30@kif    | 2020-04-07 10:49:08.092 ERROR 6 --- [nio-9081-exec-5] n.u.s.v.p.c.ProvIntegratorController     : null
webservice_prise.1.i343ddvj1g30@kif    | 
webservice_prise.1.i343ddvj1g30@kif    | java.net.ConnectException: Connection refused (Connection refused)
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.Socket.connect(Socket.java:607) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.Socket.connect(Socket.java:556) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1226) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1570) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1498) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at nl.uva.sne.vre4eic.prise.controller.ProvIntegratorController.getData(ProvIntegratorController.java:84) ~[classes!/:0.0.1-SNAPSHOT]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:106) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:888) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:793) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at javax.servlet.http.HttpServlet.service(HttpServlet.java:634) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at javax.servlet.http.HttpServlet.service(HttpServlet.java:741) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) [tomcat-embed-websocket-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:367) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1591) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_242]
webservice_prise.1.i343ddvj1g30@kif    |    at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-9.0.29.jar!/:9.0.29]
webservice_prise.1.i343ddvj1g30@kif    |    at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]

Looks like the error is at: 'nl.uva.sne.vre4eic.prise.controller.ProvIntegratorController.getData(ProvIntegratorController.java:84)'

skoulouzis commented 4 years ago

in 'docker/docker-compose.yml' comment the prise service and exposed ports for influx 8086 and for rabbit "5671-5672:5671-5672" "15672:15672" "4369:4369" "15671:15671"

run prise service from IDE in debug mode.

run sudo docker stack deploy webservice -c docker-compose.yml

run sudo docker stack deploy demo -c docker-compose_prometheus.yml

got to http://localhost:9081/index3.html

upload files: 'new_workflow.t2flow' 'workflowrun.prov.ttl'

press 'Parse input'

output is populated: Name Endpoint Method Start-time End-time GETIMAGE http://localhost:8089 GET 2020-3-24 9:33:18.275 2020-3-24 9:33:18.289 EFFECT1 http://localhost:8089/a POST 2020-3-24 9:33:18.293 2020-3-24 9:33:18.331 EFFECT2 http://localhost:8089/b POST 2020-3-24 9:33:18.335 2020-3-24 9:33:18.361

select all methods and press 'Visulize data'

Nothing is shown in page but in web boreswer console:

xhr responseText: # HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.# TYPE go_gc_duration_seconds summarygo_gc_duration_seconds{quantile="0"} 1.3365e-05go_gc_duration_seconds{quantile="0.25"} 2.6814e-05go_gc_duration_seconds{quantile="0.5"} 0.000183448go_gc_duration_seconds{quantile="0.75"} 0.000349988go_gc_duration_seconds{quantile="1"} 0.000713294go_gc_duration_seconds_sum 0.002108409go_gc_duration_seconds_count 9# HELP go_goroutines Number of goroutines that currently exist.# TYPE go_goroutines gaugego_goroutines 38# HELP go_info Information about the Go environment.# TYPE go_info gaugego_info{version="go1.13.9"} 1# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.# TYPE go_memstats_alloc_bytes gaugego_memstats_alloc_bytes 3.4815208e+07# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.# TYPE go_memstats_alloc_bytes_total countergo_memstats_alloc_bytes_total 6.2924424e+07# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.# TYPE go_memstats_buck_hash_sys_bytes gaugego_memstats_buck_hash_sys_bytes 1.458921e+06# HELP go_memstats_frees_total Total number of frees.# TYPE go_memstats_frees_total countergo_memstats_frees_total 146222# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.# TYPE go_memstats_gc_cpu_fraction gaugego_memstats_gc_cpu_fraction 6.873402381057406e-05# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.# TYPE go_memstats_gc_sys_bytes gaugego_memstats_gc_sys_bytes 2.414592e+06# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.# TYPE go_memstats_heap_alloc_bytes gaugego_memstats_heap_alloc_bytes 3.4815208e+07# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.# TYPE go_memstats_heap_idle_bytes gaugego_memstats_heap_idle_bytes 2.781184e+07# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.# TYPE go_memstats_heap_inuse_bytes gaugego_memstats_heap_inuse_bytes 3.8117376e+07# HELP go_memstats_heap_objects Number of allocated objects.# TYPE go_memstats_heap_objects gaugego_memstats_heap_objects 121472# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.# TYPE go_memstats_heap_released_bytes gaugego_memstats_heap_released_bytes 1.9390464e+07# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.# TYPE go_memstats_heap_sys_bytes gaugego_memstats_heap_sys_bytes 6.5929216e+07# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.# TYPE go_memstats_last_gc_time_seconds gaugego_memstats_last_gc_time_seconds 1.5862579567420206e+09# HELP go_memstats_lookups_total Total number of pointer lookups.# TYPE go_memstats_lookups_total countergo_memstats_lookups_total 0# HELP go_memstats_mallocs_total Total number of mallocs.# TYPE go_memstats_mallocs_total countergo_memstats_mallocs_total 267694# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.# TYPE go_memstats_mcache_inuse_bytes gaugego_memstats_mcache_inuse_bytes 13888# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.# TYPE go_memstats_mcache_sys_bytes gaugego_memstats_mcache_sys_bytes 16384# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.# TYPE go_memstats_mspan_inuse_bytes gaugego_memstats_mspan_inuse_bytes 320960# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.# TYPE go_memstats_mspan_sys_bytes gaugego_memstats_mspan_sys_bytes 344064# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.# TYPE go_memstats_next_gc_bytes gaugego_memstats_next_gc_bytes 6.7995968e+07# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.# TYPE go_memstats_other_sys_bytes gaugego_memstats_other_sys_bytes 1.730063e+06# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.# TYPE go_memstats_stack_inuse_bytes gaugego_memstats_stack_inuse_bytes 1.179648e+06# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.# TYPE go_memstats_stack_sys_bytes gaugego_memstats_stack_sys_bytes 1.179648e+06# HELP go_memstats_sys_bytes Number of bytes obtained from system.# TYPE go_memstats_sys_bytes gaugego_memstats_sys_bytes 7.3072888e+07# HELP go_threads Number of OS threads created.# TYPE go_threads gaugego_threads 18# HELP net_conntrack_dialer_conn_attempted_total Total number of connections attempted by the given dialer a given name.# TYPE net_conntrack_dialer_conn_attempted_total counternet_conntrack_dialer_conn_attempted_total{dialer_name="cadvisor"} 1net_conntrack_dialer_conn_attempted_total{dialer_name="default"} 0# HELP net_conntrack_dialer_conn_closed_total Total number of connections closed which originated from the dialer of a given name.# TYPE net_conntrack_dialer_conn_closed_total counternet_conntrack_dialer_conn_closed_total{dialer_name="cadvisor"} 0net_conntrack_dialer_conn_closed_total{dialer_name="default"} 0# HELP net_conntrack_dialer_conn_established_total Total number of connections successfully established by the given dialer a given name.# TYPE net_conntrack_dialer_conn_established_total counternet_conntrack_dialer_conn_established_total{dialer_name="cadvisor"} 1net_conntrack_dialer_conn_established_total{dialer_name="default"} 0# HELP net_conntrack_dialer_conn_failed_total Total number of connections failed to dial by the dialer a given name.# TYPE net_conntrack_dialer_conn_failed_total counternet_conntrack_dialer_conn_failed_total{dialer_name="cadvisor",reason="refused"} 0net_conntrack_dialer_conn_failed_total{dialer_name="cadvisor",reason="resolution"} 0net_conntrack_dialer_conn_failed_total{dialer_name="cadvisor",reason="timeout"} 0net_conntrack_dialer_conn_failed_total{dialer_name="cadvisor",reason="unknown"} 0net_conntrack_dialer_conn_failed_total{dialer_name="default",reason="refused"} 0net_conntrack_dialer_conn_failed_total{dialer_name="default",reason="resolution"} 0net_conntrack_dialer_conn_failed_total{dialer_name="default",reason="timeout"} 0net_conntrack_dialer_conn_failed_total{dialer_name="default",reason="unknown"} 0# HELP net_conntrack_listener_conn_accepted_total Total number of connections opened to the listener of a given name.# TYPE net_conntrack_listener_conn_accepted_total counternet_conntrack_listener_conn_accepted_total{listener_name="http"} 2# HELP net_conntrack_listener_conn_closed_total Total number of connections closed that were made to the listener of a given name.# TYPE net_conntrack_listener_conn_closed_total counternet_conntrack_listener_conn_closed_total{listener_name="http"} 0# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.# TYPE process_cpu_seconds_total counterprocess_cpu_seconds_total 2.63# HELP process_max_fds Maximum number of open file descriptors.# TYPE process_max_fds gaugeprocess_max_fds 1.048576e+06# HELP process_open_fds Number of open file descriptors.# TYPE process_open_fds gaugeprocess_open_fds 12# HELP process_resident_memory_bytes Resident memory size in bytes.# TYPE process_resident_memory_bytes gaugeprocess_resident_memory_bytes 8.0084992e+07# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.# TYPE process_start_time_seconds gaugeprocess_start_time_seconds 1.58625782876e+09# HELP process_virtual_memory_bytes Virtual memory size in bytes.# TYPE process_virtual_memory_bytes gaugeprocess_virtual_memory_bytes 1.70647552e+08# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.# TYPE process_virtual_memory_max_bytes gaugeprocess_virtual_memory_max_bytes -1# HELP prometheus_api_remote_read_queries The current number of remote read queries being executed or waiting.# TYPE prometheus_api_remote_read_queries gaugeprometheus_api_remote_read_queries 0# HELP prometheus_build_info A metric with a constant '1' value labeled by version, revision, branch, and goversion from which prometheus was built.# TYPE prometheus_build_info gaugeprometheus_build_info{branch="HEAD",goversion="go1.13.9",revision="ae041f97cfc6f43494bed65ec4ea4e3a0cf2ac69",version="2.17.1"} 1# HELP prometheus_config_last_reload_success_timestamp_seconds Timestamp of the last successful configuration reload.# TYPE prometheus_config_last_reload_success_timestamp_seconds gaugeprometheus_config_last_reload_success_timestamp_seconds 1.5862578307182932e+09# HELP prometheus_config_last_reload_successful Whether the last configuration reload attempt was successful.# TYPE prometheus_config_last_reload_successful gaugeprometheus_config_last_reload_successful 1# HELP prometheus_engine_queries The current number of queries being executed or waiting.# TYPE prometheus_engine_queries gaugeprometheus_engine_queries 0# HELP prometheus_engine_queries_concurrent_max The max number of concurrent queries.# TYPE prometheus_engine_queries_concurrent_max gaugeprometheus_engine_queries_concurrent_max 20# HELP prometheus_engine_query_duration_seconds Query timings# TYPE prometheus_engine_query_duration_seconds summaryprometheus_engine_query_duration_seconds{slice="inner_eval",quantile="0.5"} NaNprometheus_engine_query_duration_seconds{slice="inner_eval",quantile="0.9"} NaNprometheus_engine_query_duration_seconds{slice="inner_eval",quantile="0.99"} NaNprometheus_engine_query_duration_seconds_sum{slice="inner_eval"} 0prometheus_engine_query_duration_seconds_count{slice="inner_eval"} 0prometheus_engine_query_duration_seconds{slice="prepare_time",quantile="0.5"} NaNprometheus_engine_query_duration_seconds{slice="prepare_time",quantile="0.9"} NaNprometheus_engine_query_duration_seconds{slice="prepare_time",quantile="0.99"} NaNprometheus_engine_query_duration_seconds_sum{slice="prepare_time"} 0prometheus_engine_query_duration_seconds_count{slice="prepare_time"} 0prometheus_engine_query_duration_seconds{slice="queue_time",quantile="0.5"} NaNprometheus_engine_query_duration_seconds{slice="queue_time",quantile="0.9"} NaNprometheus_engine_query_duration_seconds{slice="queue_time",quantile="0.99"} NaNprometheus_engine_query_duration_seconds_sum{slice="queue_time"} 0prometheus_engine_query_duration_seconds_count{slice="queue_time"} 0prometheus_engine_query_duration_seconds{slice="result_sort",quantile="0.5"} NaNprometheus_engine_query_duration_seconds{slice="result_sort",quantile="0.9"} NaNprometheus_engine_query_duration_seconds{slice="result_sort",quantile="0.99"} NaNprometheus_engine_query_duration_seconds_sum{slice="result_sort"} 0prometheus_engine_query_duration_seconds_count{slice="result_sort"} 0# HELP prometheus_engine_query_log_enabled State of the query log.# TYPE prometheus_engine_query_log_enabled gaugeprometheus_engine_query_log_enabled 0# HELP prometheus_engine_query_log_failures_total The number of query log failures.# TYPE prometheus_engine_query_log_failures_total counterprometheus_engine_query_log_failures_total 0# HELP prometheus_notifications_alertmanagers_discovered The number of alertmanagers discovered and active.# TYPE prometheus_notifications_alertmanagers_discovered gaugeprometheus_notifications_alertmanagers_discovered 0# HELP prometheus_notifications_dropped_total Total number of alerts dropped due to errors when sending to Alertmanager.# TYPE prometheus_notifications_dropped_total counterprometheus_notifications_dropped_total 0# HELP prometheus_notifications_queue_capacity The capacity of the alert notifications queue.# TYPE prometheus_notifications_queue_capacity gaugeprometheus_notifications_queue_capacity 10000# HELP prometheus_notifications_queue_length The number of alert notifications in the queue.# TYPE prometheus_notifications_queue_length gaugeprometheus_notifications_queue_length 0# HELP prometheus_remote_storage_highest_timestamp_in_seconds Highest timestamp that has come into the remote storage via the Appender interface, in seconds since epoch.# TYPE prometheus_remote_storage_highest_timestamp_in_seconds gaugeprometheus_remote_storage_highest_timestamp_in_seconds 1.586257957e+09# HELP prometheus_remote_storage_samples_in_total Samples in to remote storage, compare to samples out for queue managers.# TYPE prometheus_remote_storage_samples_in_total counterprometheus_remote_storage_samples_in_total 478962# HELP prometheus_remote_storage_string_interner_zero_reference_releases_total The number of times release has been called for strings that are not interned.# TYPE prometheus_remote_storage_string_interner_zero_reference_releases_total counterprometheus_remote_storage_string_interner_zero_reference_releases_total 0# HELP prometheus_rule_evaluation_duration_seconds The duration for a rule to execute.# TYPE prometheus_rule_evaluation_duration_seconds summaryprometheus_rule_evaluation_duration_seconds{quantile="0.5"} NaNprometheus_rule_evaluation_duration_seconds{quantile="0.9"} NaNprometheus_rule_evaluation_duration_seconds{quantile="0.99"} NaNprometheus_rule_evaluation_duration_seconds_sum 0prometheus_rule_evaluation_duration_seconds_count 0# HELP prometheus_rule_evaluation_failures_total The total number of rule evaluation failures.# TYPE prometheus_rule_evaluation_failures_total counterprometheus_rule_evaluation_failures_total 0# HELP prometheus_rule_evaluations_total The total number of rule evaluations.# TYPE prometheus_rule_evaluations_total counterprometheus_rule_evaluations_total 0# HELP prometheus_rule_group_duration_seconds The duration of rule group evaluations.# TYPE prometheus_rule_group_duration_seconds summaryprometheus_rule_group_duration_seconds{quantile="0.01"} NaNprometheus_rule_group_duration_seconds{quantile="0.05"} NaNprometheus_rule_group_duration_seconds{quantile="0.5"} NaNprometheus_rule_group_duration_seconds{quantile="0.9"} NaNprometheus_rule_group_duration_seconds{quantile="0.99"} NaNprometheus_rule_group_duration_seconds_sum 0prometheus_rule_group_duration_seconds_count 0# HELP prometheus_rule_group_iterations_missed_total The total number of rule group evaluations missed due to slow rule group evaluation.# TYPE prometheus_rule_group_iterations_missed_total counterprometheus_rule_group_iterations_missed_total 1# HELP prometheus_rule_group_iterations_total The total number of scheduled rule group evaluations, whether executed or missed.# TYPE prometheus_rule_group_iterations_total counterprometheus_rule_group_iterations_total 0# HELP prometheus_sd_consul_rpc_duration_seconds The duration of a Consul RPC call in seconds.# TYPE prometheus_sd_consul_rpc_duration_seconds summaryprometheus_sd_consul_rpc_duration_seconds{call="service",endpoint="catalog",quantile="0.5"} NaNprometheus_sd_consul_rpc_duration_seconds{call="service",endpoint="catalog",quantile="0.9"} NaNprometheus_sd_consul_rpc_duration_seconds{call="service",endpoint="catalog",quantile="0.99"} NaNprometheus_sd_consul_rpc_duration_seconds_sum{call="service",endpoint="catalog"} 0prometheus_sd_consul_rpc_duration_seconds_count{call="service",endpoint="catalog"} 0prometheus_sd_consul_rpc_duration_seconds{call="services",endpoint="catalog",quantile="0.5"} NaNprometheus_sd_consul_rpc_duration_seconds{call="services",endpoint="catalog",quantile="0.9"} NaNprometheus_sd_consul_rpc_duration_seconds{call="services",endpoint="catalog",quantile="0.99"} NaNprometheus_sd_consul_rpc_duration_seconds_sum{call="services",endpoint="catalog"} 0prometheus_sd_consul_rpc_duration_seconds_count{call="services",endpoint="catalog"} 0# HELP prometheus_sd_consul_rpc_failures_total The number of Consul RPC call failures.# TYPE prometheus_sd_consul_rpc_failures_total counterprometheus_sd_consul_rpc_failures_total 0# HELP prometheus_sd_discovered_targets Current number of discovered targets.# TYPE prometheus_sd_discovered_targets gaugeprometheus_sd_discovered_targets{config="cadvisor",name="scrape"} 1# HELP prometheus_sd_dns_lookup_failures_total The number of DNS-SD lookup failures.# TYPE prometheus_sd_dns_lookup_failures_total counterprometheus_sd_dns_lookup_failures_total 0# HELP prometheus_sd_dns_lookups_total The number of DNS-SD lookups.# TYPE prometheus_sd_dns_lookups_total counterprometheus_sd_dns_lookups_total 0# HELP prometheus_sd_failed_configs Current number of service discovery configurations that failed to load.# TYPE prometheus_sd_failed_configs gaugeprometheus_sd_failed_configs{name="notify"} 0prometheus_sd_failed_configs{name="scrape"} 0# HELP prometheus_sd_file_read_errors_total The number of File-SD read errors.# TYPE prometheus_sd_file_read_errors_total counterprometheus_sd_file_read_errors_total 0# HELP prometheus_sd_file_scan_duration_seconds The duration of the File-SD scan in seconds.# TYPE prometheus_sd_file_scan_duration_seconds summaryprometheus_sd_file_scan_duration_seconds{quantile="0.5"} NaNprometheus_sd_file_scan_duration_seconds{quantile="0.9"} NaNprometheus_sd_file_scan_duration_seconds{quantile="0.99"} NaNprometheus_sd_file_scan_duration_seconds_sum 0prometheus_sd_file_scan_duration_seconds_count 0# HELP prometheus_sd_kubernetes_events_total The number of Kubernetes events handled.# TYPE prometheus_sd_kubernetes_events_total counterprometheus_sd_kubernetes_events_total{event="add",role="endpoints"} 0prometheus_sd_kubernetes_events_total{event="add",role="ingress"} 0prometheus_sd_kubernetes_events_total{event="add",role="node"} 0prometheus_sd_kubernetes_events_total{event="add",role="pod"} 0prometheus_sd_kubernetes_events_total{event="add",role="service"} 0prometheus_sd_kubernetes_events_total{event="delete",role="endpoints"} 0prometheus_sd_kubernetes_events_total{event="delete",role="ingress"} 0prometheus_sd_kubernetes_events_total{event="delete",role="node"} 0prometheus_sd_kubernetes_events_total{event="delete",role="pod"} 0prometheus_sd_kubernetes_events_total{event="delete",role="service"} 0prometheus_sd_kubernetes_events_total{event="update",role="endpoints"} 0prometheus_sd_kubernetes_events_total{event="update",role="ingress"} 0prometheus_sd_kubernetes_events_total{event="update",role="node"} 0prometheus_sd_kubernetes_events_total{event="update",role="pod"} 0prometheus_sd_kubernetes_events_total{event="update",role="service"} 0# HELP prometheus_sd_received_updates_total Total number of update events received from the SD providers.# TYPE prometheus_sd_received_updates_total counterprometheus_sd_received_updates_total{name="scrape"} 2# HELP prometheus_sd_updates_total Total number of update events sent to the SD consumers.# TYPE prometheus_sd_updates_total counterprometheus_sd_updates_total{name="scrape"} 1# HELP prometheus_target_interval_length_seconds Actual intervals between scrapes.# TYPE prometheus_target_interval_length_seconds summaryprometheus_target_interval_length_seconds{interval="1s",quantile="0.01"} 0.999834031prometheus_target_interval_length_seconds{interval="1s",quantile="0.05"} 0.99985955prometheus_target_interval_length_seconds{interval="1s",quantile="0.5"} 1.000034312prometheus_target_interval_length_seconds{interval="1s",quantile="0.9"} 1.00018709prometheus_target_interval_length_seconds{interval="1s",quantile="0.99"} 1.000383676prometheus_target_interval_length_seconds_sum{interval="1s"} 123.00584291300001prometheus_target_interval_length_seconds_count{interval="1s"} 123# HELP prometheus_target_metadata_cache_bytes The number of bytes that are currently used for storing metric metadata in the cache# TYPE prometheus_target_metadata_cache_bytes gaugeprometheus_target_metadata_cache_bytes{scrape_job="cadvisor"} 4106# HELP prometheus_target_metadata_cache_entries Total number of metric metadata entries in the cache# TYPE prometheus_target_metadata_cache_entries gaugeprometheus_target_metadata_cache_entries{scrape_job="cadvisor"} 83# HELP prometheus_target_scrape_pool_reloads_failed_total Total number of failed scrape loop reloads.# TYPE prometheus_target_scrape_pool_reloads_failed_total counterprometheus_target_scrape_pool_reloads_failed_total 0# HELP prometheus_target_scrape_pool_reloads_total Total number of scrape loop reloads.# TYPE prometheus_target_scrape_pool_reloads_total counterprometheus_target_scrape_pool_reloads_total 0# HELP prometheus_target_scrape_pool_sync_total Total number of syncs that were executed on a scrape pool.# TYPE prometheus_target_scrape_pool_sync_total counterprometheus_target_scrape_pool_sync_total{scrape_job="cadvisor"} 1# HELP prometheus_target_scrape_pools_failed_total Total number of scrape pool creations that failed.# TYPE prometheus_target_scrape_pools_failed_total counterprometheus_target_scrape_pools_failed_total 0# HELP prometheus_target_scrape_pools_total Total number of scrape pool creation attempts.# TYPE prometheus_target_scrape_pools_total counterprometheus_target_scrape_pools_total 1# HELP prometheus_target_scrapes_cache_flush_forced_total How many times a scrape cache was flushed due to getting big while scrapes are failing.# TYPE prometheus_target_scrapes_cache_flush_forced_total counterprometheus_target_scrapes_cache_flush_forced_total 0# HELP prometheus_target_scrapes_exceeded_sample_limit_total Total number of scrapes that hit the sample limit and were rejected.# TYPE prometheus_target_scrapes_exceeded_sample_limit_total counterprometheus_target_scrapes_exceeded_sample_limit_total 0# HELP prometheus_target_scrapes_sample_duplicate_timestamp_total Total number of samples rejected due to duplicate timestamps but different values# TYPE prometheus_target_scrapes_sample_duplicate_timestamp_total counterprometheus_target_scrapes_sample_duplicate_timestamp_total 0# HELP prometheus_target_scrapes_sample_out_of_bounds_total Total number of samples rejected due to timestamp falling outside of the time bounds# TYPE prometheus_target_scrapes_sample_out_of_bounds_total counterprometheus_target_scrapes_sample_out_of_bounds_total 0# HELP prometheus_target_scrapes_sample_out_of_order_total Total number of samples rejected due to not being out of the expected order# TYPE prometheus_target_scrapes_sample_out_of_order_total counterprometheus_target_scrapes_sample_out_of_order_total 0# HELP prometheus_target_sync_length_seconds Actual interval to sync the scrape pool.# TYPE prometheus_target_sync_length_seconds summaryprometheus_target_sync_length_seconds{scrape_job="cadvisor",quantile="0.01"} 0.000230371prometheus_target_sync_length_seconds{scrape_job="cadvisor",quantile="0.05"} 0.000230371prometheus_target_sync_length_seconds{scrape_job="cadvisor",quantile="0.5"} 0.000230371prometheus_target_sync_length_seconds{scrape_job="cadvisor",quantile="0.9"} 0.000230371prometheus_target_sync_length_seconds{scrape_job="cadvisor",quantile="0.99"} 0.000230371prometheus_target_sync_length_seconds_sum{scrape_job="cadvisor"} 0.000230371prometheus_target_sync_length_seconds_count{scrape_job="cadvisor"} 1# HELP prometheus_template_text_expansion_failures_total The total number of template text expansion failures.# TYPE prometheus_template_text_expansion_failures_total counterprometheus_template_text_expansion_failures_total 0# HELP prometheus_template_text_expansions_total The total number of template text expansions.# TYPE prometheus_template_text_expansions_total counterprometheus_template_text_expansions_total 0# HELP prometheus_treecache_watcher_goroutines The current number of watcher goroutines.# TYPE prometheus_treecache_watcher_goroutines gaugeprometheus_treecache_watcher_goroutines 0# HELP prometheus_treecache_zookeeper_failures_total The total number of ZooKeeper failures.# TYPE prometheus_treecache_zookeeper_failures_total counterprometheus_treecache_zookeeper_failures_total 0# HELP prometheus_tsdb_blocks_loaded Number of currently loaded data blocks# TYPE prometheus_tsdb_blocks_loaded gaugeprometheus_tsdb_blocks_loaded 0# HELP prometheus_tsdb_checkpoint_creations_failed_total Total number of checkpoint creations that failed.# TYPE prometheus_tsdb_checkpoint_creations_failed_total counterprometheus_tsdb_checkpoint_creations_failed_total 0# HELP prometheus_tsdb_checkpoint_creations_total Total number of checkpoint creations attempted.# TYPE prometheus_tsdb_checkpoint_creations_total counterprometheus_tsdb_checkpoint_creations_total 0# HELP prometheus_tsdb_checkpoint_deletions_failed_total Total number of checkpoint deletions that failed.# TYPE prometheus_tsdb_checkpoint_deletions_failed_total counterprometheus_tsdb_checkpoint_deletions_failed_total 0# HELP prometheus_tsdb_checkpoint_deletions_total Total number of checkpoint deletions attempted.# TYPE prometheus_tsdb_checkpoint_deletions_total counterprometheus_tsdb_checkpoint_deletions_total 0# HELP prometheus_tsdb_compaction_chunk_range_seconds Final time range of chunks on their first compaction# TYPE prometheus_tsdb_compaction_chunk_range_seconds histogramprometheus_tsdb_compaction_chunk_range_seconds_bucket{le="100"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="400"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="1600"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="6400"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="25600"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="102400"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="409600"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="1.6384e+06"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="6.5536e+06"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="2.62144e+07"} 0prometheus_tsdb_compaction_chunk_range_seconds_bucket{le="+Inf"} 0prometheus_tsdb_compaction_chunk_range_seconds_sum 0prometheus_tsdb_compaction_chunk_range_seconds_count 0# HELP prometheus_tsdb_compaction_chunk_samples Final number of samples on their first compaction# TYPE prometheus_tsdb_compaction_chunk_samples histogramprometheus_tsdb_compaction_chunk_samples_bucket{le="4"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="6"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="9"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="13.5"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="20.25"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="30.375"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="45.5625"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="68.34375"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="102.515625"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="153.7734375"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="230.66015625"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="345.990234375"} 0prometheus_tsdb_compaction_chunk_samples_bucket{le="+Inf"} 0prometheus_tsdb_compaction_chunk_samples_sum 0prometheus_tsdb_compaction_chunk_samples_count 0# HELP prometheus_tsdb_compaction_chunk_size_bytes Final size of chunks on their first compaction# TYPE prometheus_tsdb_compaction_chunk_size_bytes histogramprometheus_tsdb_compaction_chunk_size_bytes_bucket{le="32"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="48"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="72"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="108"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="162"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="243"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="364.5"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="546.75"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="820.125"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="1230.1875"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="1845.28125"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="2767.921875"} 0prometheus_tsdb_compaction_chunk_size_bytes_bucket{le="+Inf"} 0prometheus_tsdb_compaction_chunk_size_bytes_sum 0prometheus_tsdb_compaction_chunk_size_bytes_count 0# HELP prometheus_tsdb_compaction_duration_seconds Duration of compaction runs# TYPE prometheus_tsdb_compaction_duration_seconds histogramprometheus_tsdb_compaction_duration_seconds_bucket{le="1"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="2"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="4"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="8"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="16"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="32"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="64"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="128"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="256"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="512"} 0prometheus_tsdb_compaction_duration_seconds_bucket{le="+Inf"} 0prometheus_tsdb_compaction_duration_seconds_sum 0prometheus_tsdb_compaction_duration_seconds_count 0# HELP prometheus_tsdb_compaction_populating_block Set to 1 when a block is currently being written to the disk.# TYPE prometheus_tsdb_compaction_populating_block gaugeprometheus_tsdb_compaction_populating_block 0# HELP prometheus_tsdb_compactions_failed_total Total number of compactions that failed for the partition.# TYPE prometheus_tsdb_compactions_failed_total counterprometheus_tsdb_compactions_failed_total 0# HELP prometheus_tsdb_compactions_skipped_total Total number of skipped compactions due to disabled auto compaction.# TYPE prometheus_tsdb_compactions_skipped_total counterprometheus_tsdb_compactions_skipped_total 0# HELP prometheus_tsdb_compactions_total Total number of compactions that were executed for the partition.# TYPE prometheus_tsdb_compactions_total counterprometheus_tsdb_compactions_total 0# HELP prometheus_tsdb_compactions_triggered_total Total number of triggered compactions for the partition.# TYPE prometheus_tsdb_compactions_triggered_total counterprometheus_tsdb_compactions_triggered_total 2# HELP prometheus_tsdb_head_active_appenders Number of currently active appender transactions# TYPE prometheus_tsdb_head_active_appenders gaugeprometheus_tsdb_head_active_appenders 0# HELP prometheus_tsdb_head_chunks Total number of chunks in the head block.# TYPE prometheus_tsdb_head_chunks gaugeprometheus_tsdb_head_chunks 7788# HELP prometheus_tsdb_head_chunks_created_total Total number of chunks created in the head# TYPE prometheus_tsdb_head_chunks_created_total counterprometheus_tsdb_head_chunks_created_total 7788# HELP prometheus_tsdb_head_chunks_removed_total Total number of chunks removed in the head# TYPE prometheus_tsdb_head_chunks_removed_total counterprometheus_tsdb_head_chunks_removed_total 0# HELP prometheus_tsdb_head_gc_duration_seconds Runtime of garbage collection in the head block.# TYPE prometheus_tsdb_head_gc_duration_seconds summaryprometheus_tsdb_head_gc_duration_seconds_sum 0prometheus_tsdb_head_gc_duration_seconds_count 0# HELP prometheus_tsdb_head_max_time Maximum timestamp of the head block. The unit is decided by the library consumer.# TYPE prometheus_tsdb_head_max_time gaugeprometheus_tsdb_head_max_time 1.586257957735e+12# HELP prometheus_tsdb_head_max_time_seconds Maximum timestamp of the head block.# TYPE prometheus_tsdb_head_max_time_seconds gaugeprometheus_tsdb_head_max_time_seconds 1.586257957e+09# HELP prometheus_tsdb_head_min_time Minimum time bound of the head block. The unit is decided by the library consumer.# TYPE prometheus_tsdb_head_min_time gaugeprometheus_tsdb_head_min_time 1.586257835735e+12# HELP prometheus_tsdb_head_min_time_seconds Minimum time bound of the head block.# TYPE prometheus_tsdb_head_min_time_seconds gaugeprometheus_tsdb_head_min_time_seconds 1.586257835e+09# HELP prometheus_tsdb_head_samples_appended_total Total number of appended samples.# TYPE prometheus_tsdb_head_samples_appended_total counterprometheus_tsdb_head_samples_appended_total 478962# HELP prometheus_tsdb_head_series Total number of series in the head block.# TYPE prometheus_tsdb_head_series gaugeprometheus_tsdb_head_series 3894# HELP prometheus_tsdb_head_series_created_total Total number of series created in the head# TYPE prometheus_tsdb_head_series_created_total counterprometheus_tsdb_head_series_created_total 3894# HELP prometheus_tsdb_head_series_not_found_total Total number of requests for series that were not found.# TYPE prometheus_tsdb_head_series_not_found_total counterprometheus_tsdb_head_series_not_found_total 0# HELP prometheus_tsdb_head_series_removed_total Total number of series removed in the head# TYPE prometheus_tsdb_head_series_removed_total counterprometheus_tsdb_head_series_removed_total 0# HELP prometheus_tsdb_head_truncations_failed_total Total number of head truncations that failed.# TYPE prometheus_tsdb_head_truncations_failed_total counterprometheus_tsdb_head_truncations_failed_total 0# HELP prometheus_tsdb_head_truncations_total Total number of head truncations attempted.# TYPE prometheus_tsdb_head_truncations_total counterprometheus_tsdb_head_truncations_total 0# HELP prometheus_tsdb_isolation_high_watermark The highest TSDB append ID that has been given out.# TYPE prometheus_tsdb_isolation_high_watermark gaugeprometheus_tsdb_isolation_high_watermark 246# HELP prometheus_tsdb_isolation_low_watermark The lowest TSDB append ID that is still referenced.# TYPE prometheus_tsdb_isolation_low_watermark gaugeprometheus_tsdb_isolation_low_watermark 246# HELP prometheus_tsdb_lowest_timestamp Lowest timestamp value stored in the database. The unit is decided by the library consumer.# TYPE prometheus_tsdb_lowest_timestamp gaugeprometheus_tsdb_lowest_timestamp 1.586257835735e+12# HELP prometheus_tsdb_lowest_timestamp_seconds Lowest timestamp value stored in the database.# TYPE prometheus_tsdb_lowest_timestamp_seconds gaugeprometheus_tsdb_lowest_timestamp_seconds 1.586257835e+09# HELP prometheus_tsdb_reloads_failures_total Number of times the database failed to reload block data from disk.# TYPE prometheus_tsdb_reloads_failures_total counterprometheus_tsdb_reloads_failures_total 0# HELP prometheus_tsdb_reloads_total Number of times the database reloaded block data from disk.# TYPE prometheus_tsdb_reloads_total counterprometheus_tsdb_reloads_total 1# HELP prometheus_tsdb_retention_limit_bytes Max number of bytes to be retained in the tsdb blocks, configured 0 means disabled# TYPE prometheus_tsdb_retention_limit_bytes gaugeprometheus_tsdb_retention_limit_bytes 0# HELP prometheus_tsdb_size_retentions_total The number of times that blocks were deleted because the maximum number of bytes was exceeded.# TYPE prometheus_tsdb_size_retentions_total counterprometheus_tsdb_size_retentions_total 0# HELP prometheus_tsdb_storage_blocks_bytes The number of bytes that are currently used for local storage by all blocks.# TYPE prometheus_tsdb_storage_blocks_bytes gaugeprometheus_tsdb_storage_blocks_bytes 0# HELP prometheus_tsdb_symbol_table_size_bytes Size of symbol table on disk (in bytes)# TYPE prometheus_tsdb_symbol_table_size_bytes gaugeprometheus_tsdb_symbol_table_size_bytes 0# HELP prometheus_tsdb_time_retentions_total The number of times that blocks were deleted because the maximum time limit was exceeded.# TYPE prometheus_tsdb_time_retentions_total counterprometheus_tsdb_time_retentions_total 0# HELP prometheus_tsdb_tombstone_cleanup_seconds The time taken to recompact blocks to remove tombstones.# TYPE prometheus_tsdb_tombstone_cleanup_seconds histogramprometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.005"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.01"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.025"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.05"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.1"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.25"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="0.5"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="1"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="2.5"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="5"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="10"} 0prometheus_tsdb_tombstone_cleanup_seconds_bucket{le="+Inf"} 0prometheus_tsdb_tombstone_cleanup_seconds_sum 0prometheus_tsdb_tombstone_cleanup_seconds_count 0# HELP prometheus_tsdb_vertical_compactions_total Total number of compactions done on overlapping blocks.# TYPE prometheus_tsdb_vertical_compactions_total counterprometheus_tsdb_vertical_compactions_total 0# HELP prometheus_tsdb_wal_completed_pages_total Total number of completed pages.# TYPE prometheus_tsdb_wal_completed_pages_total counterprometheus_tsdb_wal_completed_pages_total 185# HELP prometheus_tsdb_wal_corruptions_total Total number of WAL corruptions.# TYPE prometheus_tsdb_wal_corruptions_total counterprometheus_tsdb_wal_corruptions_total 0# HELP prometheus_tsdb_wal_fsync_duration_seconds Duration of WAL fsync.# TYPE prometheus_tsdb_wal_fsync_duration_seconds summaryprometheus_tsdb_wal_fsync_duration_seconds{quantile="0.5"} NaNprometheus_tsdb_wal_fsync_duration_seconds{quantile="0.9"} NaNprometheus_tsdb_wal_fsync_duration_seconds{quantile="0.99"} NaNprometheus_tsdb_wal_fsync_duration_seconds_sum 0prometheus_tsdb_wal_fsync_duration_seconds_count 0# HELP prometheus_tsdb_wal_page_flushes_total Total number of page flushes.# TYPE prometheus_tsdb_wal_page_flushes_total counterprometheus_tsdb_wal_page_flushes_total 433# HELP prometheus_tsdb_wal_segment_current WAL segment index that TSDB is currently writing to.# TYPE prometheus_tsdb_wal_segment_current gaugeprometheus_tsdb_wal_segment_current 0# HELP prometheus_tsdb_wal_truncate_duration_seconds Duration of WAL truncation.# TYPE prometheus_tsdb_wal_truncate_duration_seconds summaryprometheus_tsdb_wal_truncate_duration_seconds_sum 0prometheus_tsdb_wal_truncate_duration_seconds_count 0# HELP prometheus_tsdb_wal_truncations_failed_total Total number of WAL truncations that failed.# TYPE prometheus_tsdb_wal_truncations_failed_total counterprometheus_tsdb_wal_truncations_failed_total 0# HELP prometheus_tsdb_wal_truncations_total Total number of WAL truncations attempted.# TYPE prometheus_tsdb_wal_truncations_total counterprometheus_tsdb_wal_truncations_total 0# HELP prometheus_tsdb_wal_writes_failed_total Total number of WAL writes that failed.# TYPE prometheus_tsdb_wal_writes_failed_total counterprometheus_tsdb_wal_writes_failed_total 0# HELP promhttp_metric_handler_requests_in_flight Current number of scrapes being served.# TYPE promhttp_metric_handler_requests_in_flight gaugepromhttp_metric_handler_requests_in_flight 1# HELP promhttp_metric_handler_requests_total Total number of scrapes by HTTP status code.# TYPE promhttp_metric_handler_requests_total counterpromhttp_metric_handler_requests_total{code="200"} 0promhttp_metric_handler_requests_total{code="500"} 0promhttp_metric_handler_requests_total{code="503"} 0
getData.js:151:13
prm: # HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.# TYPE go_gc_duration_seconds summarygo_gc_duration_seconds{quantile="0"} 1.3365e-05go_gc_duration_seconds{quantile="0.25"} 2.6814e-05go_gc_duration_seconds{quantile="0.5"} 0.000183448go_gc_duration_seconds{quantile="0.75"} 0.000349988go_gc_duration_seconds{quantile="1"} 0.000713294go_gc_duration_seconds_sum 0.002108409go_gc_duration_seconds_count 9# HELP go_goroutines Number of goroutines that currently exist.# TYPE go_goroutines gaugego_goroutines 38# HELP go_info Information about the Go environment.# TYPE go_info gaugego_info{version="go1.13.9"} 1# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.# TYPE go_memstats_alloc_bytes gaugego_memstats_alloc_bytes 3.4815208e+07# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.# TYPE go_memstats_alloc_bytes_total countergo_memstats_alloc_bytes_total 6.2924424e+07# HELP go_memstats_buck_hash_…
getData.js:71:21
Array [ "# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.# TYPE go_gc_duration_seconds summarygo_gc_duration_seconds{quantile=\"0\"} 1.3365e-05go_gc_duration_seconds{quantile=\"0.25\"} 2.6814e-05go_gc_duration_seconds{quantile=\"0.5\"} 0.000183448go_gc_duration_seconds{quantile=\"0.75\"} 0.000349988go_gc_duration_seconds{quantile=\"1\"} 0.000713294go_gc_duration_seconds_sum 0.002108409go_gc_duration_seconds_count 9# HELP go_goroutines Number of goroutines that currently exist.# TYPE go_goroutines gaugego_goroutines 38# HELP go_info Information about the Go environment.# TYPE go_info gaugego_info{version=\"go1.13.9\"} 1# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.# TYPE go_memstats_alloc_bytes gaugego_memstats_alloc_bytes 3.4815208e+07# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.# TYPE go_memstats_alloc_bytes_total countergo_memstats_alloc_bytes_total 6.2924424e+07# HELP go_memstats_buck_hash_sys_b…" ]
getData.js:46:13
{} getData.js:54:21
formatData/<@http://localhost:9081/getData.js:105:17
formatData@http://localhost:9081/getData.js:104:26
getData/<@http://localhost:9081/getData.js:55:27
getData.js:58:21

When doing the same in and running the price service via docker-compose we get the 'java.net.ConnectException: Connection refused (Connection refused)'

If we look at the logs some lines before we see the url: ' queryURL: http://localhost:9090/metrics?endpoint=http://localhost:9090'

This means that the price service is trying to connect to 'http://localhost:9090/metrics' instead of 'http://prometheus:9090/metrics' which runs in the docker-compose_prometheus.yml

skoulouzis commented 4 years ago

So the source of the bug comes from the assumption that the web service invoked by the workflow and Prometheus will be running on the same host with a publicly accessible IP address.

To solve this error deploy the 'docker_workflow/docker-compose_prometheus.yml' on a host with a publically accessible IP address.

In general, we need to redesign the architecture and include a service registry so Log2Prov knows where to access metrics services, log services etc.

Here is a suggested architecture: Untitled drawing

AXinx commented 4 years ago

web service invoked by the workflow and Prometheus will be running on the same host with a publicly accessible IP address. To solve this error deploy the 'docker_workflow/docker-compose_prometheus.yml' on a host with a publically accessible IP address.

I am still confused about how to set them? Does this mean "localhost" is not available? Should I set them as "192.168.1.178" which is my laptop IP address?

In general, we need to redesign the architecture and include a service registry so Log2Prov knows where to access metrics services, log services etc.

I understand this architecture now. But how to create the service registry? I mean how to make it available in code?