Queries regarding saving the data

[abhay40711cs]

I need to save the data and to show in Grafana. Is there any plugin which can transfer data to promethesus?

[mattcolegate]

Hi @abhay40711cs , I don't know about Promethesus but appmetrics (which appmetrics-dash uses under the covers to gather data) can be run in File Collection Mode which will store data to an *.hcd archive format. On the other hand, as you mention Grafana, you might want to take a look at appmetrics-elk which can send data to an ElasticSearch instance which can be used with Grafana.

[abhay40711cs]

Thanks @mattcolegate : Would you suggest how to run appmetrics dash in file collection mode, and can this data (.hcd) format is able to be imported to Grafana ? Then sole purpose will be fulfilled.

I tried the appmetrics-elk but it seems to be obsolete with the Kibana and existing node.js versions. https://github.com/RuntimeTools/appmetrics-elk/issues/25#issuecomment-318575080

[seabaylea]

@abhay40711cs we're actually going to be supporting a Prometheus endpoint very shortly. Do you have any specific data that you'd like access to? (so that we can prioritise what to expose first)?

[abhay40711cs]

@seabaylea : Thanks for giving a thought for this. no of HTTP request, Error Rate vs Routed URI Address and Throughput.

apart from this any thought for upgrading appmetricks-elk ?

[seabaylea]

Currently we're looking at providing the following for HTTP:

# HELP http_request_duration_microseconds The HTTP request latencies in microseconds.
# TYPE http_request_duration_microseconds summary 
# HELP http_requests_total Total number of HTTP requests made.
# TYPE http_requests_total counter

each of which would be broken down with per-route data. You should then be able to generate rate/throughput queries in Prometheus.

For error rate, would a single count for any request that doesn't result in 200-OK make sense, or would you need counts of 3xx vs. 4xx etc.?

[abhay40711cs]

This is great Chris, Endpoint metrics generation will help in order to reduce the code changes.

• For error rates, if they can be segregated with 300 and 400, 500 will help in order to identify the rejected request at the time of load test.

Regards, Abhay

On Mon, Aug 21, 2017 at 4:54 PM, Chris Bailey notifications@github.com wrote:

Currently we're looking at providing the following for HTTP:

HELP http_request_duration_microseconds The HTTP request latencies in microseconds.

TYPE http_request_duration_microseconds summary

HELP http_requests_total Total number of HTTP requests made.

TYPE http_requests_total counter

each of which would be broken down with per-route data. You should then be able to generate rate/throughput queries in Prometheus.

For error rate, would a single count for any request that doesn't result in 200-OK make sense, or would you need counts of 3xx vs. 4xx etc.?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/RuntimeTools/appmetrics-dash/issues/105#issuecomment-323719175, or mute the thread https://github.com/notifications/unsubscribe-auth/AVB5SQ9EnQgIAgUL330dM285vhvgjTVuks5saWj1gaJpZM4O8UDZ .

[abhay40711cs]

Any check-in for the end points on Prometheus?

On Mon, Aug 21, 2017 at 9:14 PM, Abhay Kulshrestha abhay40711cs@gmail.com wrote:

This is great Chris, Endpoint metrics generation will help in order to reduce the code changes.

• For error rates, if they can be segregated with 300 and 400, 500 will help in order to identify the rejected request at the time of load test.

Regards, Abhay

On Mon, Aug 21, 2017 at 4:54 PM, Chris Bailey notifications@github.com wrote:

Currently we're looking at providing the following for HTTP:

HELP http_request_duration_microseconds The HTTP request latencies in microseconds.

TYPE http_request_duration_microseconds summary

HELP http_requests_total Total number of HTTP requests made.

TYPE http_requests_total counter

each of which would be broken down with per-route data. You should then be able to generate rate/throughput queries in Prometheus.

For error rate, would a single count for any request that doesn't result in 200-OK make sense, or would you need counts of 3xx vs. 4xx etc.?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/RuntimeTools/appmetrics-dash/issues/105#issuecomment-323719175, or mute the thread https://github.com/notifications/unsubscribe-auth/AVB5SQ9EnQgIAgUL330dM285vhvgjTVuks5saWj1gaJpZM4O8UDZ .

[seabaylea]

Hi @abhay40711cs. I can tell you that work is underway - I've got a very early WIP here: https://github.com/seabaylea/appmetrics-prometheus

Note that we still haven't decided/determined whether we should add support into appmetrics-dash, or make it a separate module.

[tobespc]

I'm leaning more and more towards have this as a separate module rather than part of appmetrics-dash

[tobespc]

@abhay40711cs We have released an early driver of our prometheus adaptor to github this morning

https://github.com/RuntimeTools/appmetrics-prometheus

[abhay40711cs]

Thanks for the initiative. Just a quick question, would that be possible to have custom endpoint apart from /metrics ? The reason behind it there are wrappers around client library 'prom-client' , who also provides the metrics on the same endpoint.

On Tue, Sep 5, 2017 at 5:59 PM, Toby Corbin notifications@github.com wrote:

@abhay40711cs https://github.com/abhay40711cs We have released an early driver of our prometheus adaptor to github this morning

https://github.com/RuntimeTools/appmetrics-prometheus

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/RuntimeTools/appmetrics-dash/issues/105#issuecomment-327160459, or mute the thread https://github.com/notifications/unsubscribe-auth/AVB5SZerM9N6obXHRL8cJJhX65FuxGPKks5sfT6ggaJpZM4O8UDZ .

[seabaylea]

Hi @abhay40711cs . Can you raise an issue in the appmetrics-prometheus project to make the endpoint configurable?

If you have any suggestions on how you'd like to configure it, that would also be useful (its also fine if you don't mind how its done!)