[Feature Request]: Gauge metrics in stackdriver

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

https://beam.apache.org/

Apache License 2.0

7.76k stars 4.21k forks source link

[Feature Request]: Gauge metrics in stackdriver #24089

Open inessa-nbcuni opened 1 year ago

inessa-nbcuni commented 1 year ago

What happened?

Java Beam version: 2.39.0

The following code doenst seem to work.

There are no error messages reported in the logs as well.
There are no quota issues
This code is used in DataFlow pipeline

Code sample:

private final Gauge numSuccessfulApiRequests = Metrics.gauge(MyClass.class, "num_successful_api_requests");
log.info("MyClass, setting gauge metric");
numSuccessfulApiRequests.set(1);

Issue Priority

Priority: 1

Issue Component

Component: beam-community

kennknowles commented 1 year ago

Dataflow currently only reports Counter and Distribution metrics to StackDriver. See https://cloud.google.com/dataflow/docs/guides/using-cloud-monitoring#custom_metrics

kennknowles commented 1 year ago

Actually I will reopen this as a feature request (there may be other issues that already record this feature request)

damccorm commented 1 year ago

This got added to the 2.44 milestone via close/reopen and is probably not a real release blocker

wikp commented 1 year ago

Hi All :) I see that this was removed from 2.44.0. Is there any chance for this feature to be released in a foreseeable future?

carlpayne commented 1 year ago

+1 for supporting Gauge metrics, this would be very useful for us with Dataflow 😃