Resource Metrics as Config

[mrueg]

What would you like to be added:

@dgrisonnet described this idea in a private chat a while ago and I want to avoid that we forget it, so I'm tracking it here.

The goal would be to replace existing core metrics with a configuration based approach similar to existing customresourcestate metrics. That way users can alter, remove and update metrics via a configuration to ensure they contain what the users need. KSM would still supply a standard config.

Why is this needed: Some users would like to create metrics that are not desired in standard workloads (e.g. due to high cardinality). With metrics as config, we allow these users to define their own metric without causing issues or additional complexity (allowlists/denylists) for the rest of the users.

Describe the solution you'd like

Similar to customresourcestate metrics but with a more intuitive configuration syntax.

Additional context

[dgrisonnet]

Thank you for writing it out Manuel! :)

/triage accepted

[k8s-triage-robot]

This issue has not been updated in over 1 year, and should be re-triaged.

You can:

• Confirm that this issue is still relevant with /triage accepted (org members only)
• Close this issue with /close

For more details on the triage process, see https://www.kubernetes.dev/docs/guide/issue-triage/

/remove-triage accepted

[mrueg]

/triage accepted