Directly ingest logs into Datadog

[kevin-v-ngo]

This issue tracks a tighter integration with Datadog to support finer granularity and longer retention of SQL stats. We'd like to support emitting our sampled logs directly to Datadog via the Datadog HTTP API. This will help support higher throughput (avoid writing to disc) data ingestion for data intensive applications. Cluster Observability has a PR to format the logs in JSON array format. The following issues remain:

• [x] compress the data using gzip and setting the appropriate header
• [x] reading the DD api key and setting the appropriate header

Epic: CRDB-25399

Jira issue: CRDB-28022

[kevin-v-ngo]

@xinhaoz - can you clarify what's left for this issue?

[xinhaoz]

@kevin-v-ngo The PR I have is just to format the logs in JSON array format -- we still need:

• compress the data using gzip and setting the appropriate header
• reading the DD api key and setting the appropriate header