uber / RemoteShuffleService

Remote shuffle service for Apache Spark to store shuffle data on remote servers.
Other
321 stars 100 forks source link

Metrics in ScheduledMetricCollector #72

Closed Lobo2008 closed 2 years ago

Lobo2008 commented 2 years ago

Hi, I am puzzle with monitoring the RSS cluster. In StreamServer.java there is code in main

ScheduledMetricCollector scheduledMetricCollector = new ScheduledMetricCollector(server.serviceRegistry);
scheduledMetricCollector.scheduleCollectingMetrics(...);

this scheduledMetricCollector has Gauges including activeNodeCountnumFileDescriptorsunreachableHosts

How should I send these metrics above to DB or else where If we want to monitor the RSS cluster ?