adobe / helix-run-query

service that executes queries on BigQuery datasets generated by Helix-Logging
Apache License 2.0
6 stars 11 forks source link

[Feature] Log costs of a query to Coralogix #1143

Closed lydiapuric closed 3 months ago

lydiapuric commented 3 months ago

Is your feature request related to a problem? Please describe. Log costs of a query to Coralogix

Describe the solution you'd like Log costs of a query to Coralogix and decode domain key information to be able to assign the costs to a key.

Describe alternatives you've considered Pure SQL, however domain keys are being stored as binaries and passed as parameters to prevent data leakage into logs. So this is not possible.

Additional context Encode domain key.

lydiapuric commented 3 months ago

WIP in https://github.com/adobe/helix-run-query/compare/main...log-costs-per-query

lydiapuric commented 3 months ago

Reopening because we report only on jobs with # hlx:metadata. This is not enough