Abstract prometheus metrics into interfaces

[jonathan-innis]

Fixes #N/A

Description

This leverages https://github.com/awslabs/operatorpkg/pull/92 to create abstract metrics so that you can create an arbitrary pipeline for routing metrics beyond prometheus

For instance,

status.TerminationDuration = pmetrics.NewMultiObservation(
    status.TerminationDuration,
    pmetrics.NewEMFObservation(writer, "operatorpkg", "operator_termination_duration_seconds", []string{"group", "kind", "namespace"}),
)

How was this change tested?

make presubmit

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[k8s-ci-robot]

Skipping CI for Draft Pull Request. If you want CI signal for your change, please convert it to an actual PR. You can still manually trigger a test run with /test all

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jonathan-innis

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/kubernetes-sigs/karpenter/blob/main/OWNERS)~~ [jonathan-innis] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment

[coveralls]

Pull Request Test Coverage Report for Build 11748062451

Details

• 110 of 126 (87.3%) changed or added relevant lines in 24 files are covered.
• 7 unchanged lines in 1 file lost coverage.
• Overall coverage decreased (-0.1%) to 80.789%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
pkg/controllers/disruption/multinodeconsolidation.go	0	1	0.0%
pkg/controllers/disruption/singlenodeconsolidation.go	0	1	0.0%
pkg/cloudprovider/metrics/cloudprovider.go	0	14	0.0%
<!--	Total:	110	126	87.3%	-->

Files with Coverage Reduction	New Missed Lines	%
pkg/controllers/provisioning/scheduling/preferences.go	7	86.67%
<!--	Total:	7		-->

Totals
Change from base Build 11747362633:	-0.1%
Covered Lines:	8453
Relevant Lines:	10463

---

💛 - Coveralls