newrelic-experimental / newrelic-databricks-integration

This integration collects telemetry from Databricks (including Spark on Databricks) and/or Spark telemetry from any Spark deployment. See the Features section for supported telemetry types.

Apache License 2.0

2 stars 0 forks source link

feat: collect job cost data #42

Closed sdewitt-newrelic closed 1 month ago

sdewitt-newrelic commented 1 month ago

Description

Adds:

Introduced generic query receiver component
Created usagequeries.go for defining all consumption and cost queries
Extracted billable usage and list price queries to usagequeries.go
Added new job cost queries to usagequeries.go
Use query receiver to execute billable usage and job cost queries
Added flags to selectively enable/disable job cost queries
Reworked and renamed cost and consumption dashboard and added job cost page
Updated documentation

Type of change

[X] New feature (non-breaking change which adds functionality)
[X] This change requires a documentation update

Checklist:

[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my code
[X] I have commented my code, particularly in hard-to-understand areas
[X] I have made corresponding changes to the documentation
[X] My changes generate no new warnings