fix: configurable telegraf schema support

metrico / qryn

⭐️ All-in-One Polyglot Observability with OLAP Storage for Logs, Metrics, Traces & Profiles. Drop-in Grafana Cloud replacement compatible with Loki, Prometheus, Tempo, Pyroscope, Opentelemetry, Datadog and beyond :rocket:

https://qryn.dev

GNU Affero General Public License v3.0

1.19k stars 67 forks source link

fix: configurable telegraf schema support #437

Closed akvlad closed 8 months ago

akvlad commented 8 months ago

for #433

add ADVANCED_TELEGRAF_METRICS_SCHEMA config to support https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/influxdbexporter telegraf-prometheus-v2
check values type for influx writes

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (20)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (20)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011918000, 1706011919000
    Initialize containers : 1706011919000, 1706011929000
    Run actions/checkout@v4 : 1706011930000, 1706011930000
    Use Node.js 20 : 1706011930000, 1706011932000
    Run npm install : 1706011932000, 1706011942000
    Run npm run postinstall : 1706011943000, 1706011943000
    Run git submodule init : 1706011943000, 1706011943000
    Run git submodule update : 1706011943000, 1706011944000
    Workflow Telemetry : 1706011944000, 1706011944000
    Run node qryn.mjs >/dev/stdout & npm run test --forceExit : 1706011944000, 1706011977000

CPU Metrics

chart_stacked_area_time_fe33ab48-908f-4518-b8b0-e640fb3692ab

Memory Metrics

chart_stacked_area_time_0b85823d-f3bd-4098-9341-568db28b1d3f

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (20)
    dateFormat x
    axisFormat %H:%M:%S
    jest : 1706011944872, 1706011972924
    node : 1706011944872, 1706011972924
    node : 1706011945042, 1706011945076
    find : 1706011945334, 1706011945340
    find : 1706011945347, 1706011945716
    node : 1706011945741, 1706011945847
    node : 1706011945745, 1706011945841
    node : 1706011945748, 1706011945849
    node : 1706011945870, 1706011972866
    node : 1706011945874, 1706011972874
    node : 1706011945877, 1706011972875
    node : 1706011945966, 1706011946021
    node : 1706011945974, 1706011946025
    node : 1706011945981, 1706011946023

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (16.x)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (16.x)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011921000, 1706011923000
    Initialize containers : 1706011923000, 1706011934000
    Run actions/checkout@v4 : 1706011934000, 1706011935000
    Use Node.js 16.x : 1706011935000, 1706011939000
    Run npm install : 1706011939000, 1706011950000
    Run npm run postinstall : 1706011950000, 1706011950000
    Run git submodule init : 1706011950000, 1706011950000
    Run git submodule update : 1706011951000, 1706011951000
    Workflow Telemetry : 1706011951000, 1706011951000
    Run node qryn.mjs >/dev/stdout & npm run test --forceExit : 1706011952000, 1706011986000

CPU Metrics

chart_stacked_area_time_171b2281-f2b8-45cc-bdf0-a43cbf0be1cf

Memory Metrics

chart_stacked_area_time_33b7cccd-3fd3-4352-b900-4ecd3a379c3d

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (16.x)
    dateFormat x
    axisFormat %H:%M:%S
    bash : 1706011951844, 1706011981480
    npm : 1706011951846, 1706011981476
    node : 1706011951846, 1706011981476
    jest : 1706011952131, 1706011981474
    node : 1706011952131, 1706011981474
    node : 1706011952294, 1706011952332
    find : 1706011952682, 1706011952683
    find : 1706011952693, 1706011953189
    node : 1706011953222, 1706011953492
    node : 1706011953250, 1706011953486
    node : 1706011953267, 1706011953463
    node : 1706011953525, 1706011981460
    node : 1706011953532, 1706011981428
    node : 1706011953551, 1706011981419
    node : 1706011953653, 1706011953747
    node : 1706011953766, 1706011953891
    node : 1706011953802, 1706011953919

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (18)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (18)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011921000, 1706011923000
    Initialize containers : 1706011923000, 1706011934000
    Run actions/checkout@v4 : 1706011934000, 1706011935000
    Use Node.js 18 : 1706011935000, 1706011939000
    Run npm install : 1706011939000, 1706011952000
    Run npm run postinstall : 1706011953000, 1706011953000
    Run git submodule init : 1706011953000, 1706011953000
    Run git submodule update : 1706011954000, 1706011954000
    Workflow Telemetry : 1706011955000, 1706011955000

CPU Metrics

chart_stacked_area_time_a7da4a05-c0ef-4827-ae89-a0247fac4834

Memory Metrics

chart_stacked_area_time_9949d9de-16cb-4888-a525-a5650c431c1c

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (18)
    dateFormat x
    axisFormat %H:%M:%S
    bash : 1706011955030, 1706011984069
    npm : 1706011955032, 1706011984064
    node : 1706011955032, 1706011984064
    jest : 1706011955401, 1706011984060
    node : 1706011955401, 1706011984060
    node : 1706011955604, 1706011955652
    find : 1706011955943, 1706011955944
    find : 1706011955953, 1706011956356
    node : 1706011956380, 1706011956495
    node : 1706011956385, 1706011956497
    node : 1706011956388, 1706011956494
    node : 1706011956519, 1706011984023
    node : 1706011956521, 1706011984016
    node : 1706011956524, 1706011984033
    node : 1706011956606, 1706011956643
    node : 1706011956624, 1706011956667
    node : 1706011956628, 1706011956680

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (18)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (18)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011919000, 1706011920000
    Run actions/checkout@v4 : 1706011921000, 1706011922000
    Use Node.js 18 : 1706011922000, 1706011924000
    Run npm install : 1706011924000, 1706011938000
    Run npm run postinstall : 1706011938000, 1706011938000
    Run git submodule init : 1706011938000, 1706011938000
    Run git submodule update : 1706011939000, 1706011939000
    Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1706011940000, 1706011950000
    Run sleep 5 : 1706011950000, 1706011955000
    Workflow Telemetry : 1706011955000, 1706011955000
    Run node qryn.mjs >/dev/stdout & : 1706011955000, 1706011960000

CPU Metrics

chart_stacked_area_time_d2680659-e2e4-47aa-8b1a-b2b646405868

Memory Metrics

chart_stacked_area_time_cb6e4585-4532-48c0-8bcc-3bdbb6f24da4

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (18)
    dateFormat x
    axisFormat %H:%M:%S
    bash : 1706011955861, 1706011955862
    bash : 1706011960879, 1706011991243
    npm : 1706011960881, 1706011991239
    node : 1706011960881, 1706011991239
    jest : 1706011961172, 1706011991235
    node : 1706011961172, 1706011991235
    node : 1706011961360, 1706011961393
    find : 1706011961612, 1706011961613
    find : 1706011961619, 1706011961802
    node : 1706011961825, 1706011961917
    node : 1706011961829, 1706011961918
    node : 1706011961832, 1706011961917
    node : 1706011961937, 1706011991198
    node : 1706011961939, 1706011991193
    node : 1706011961942, 1706011991216
    node : 1706011962034, 1706011962076
    node : 1706011962038, 1706011962072
    node : 1706011962049, 1706011962096

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (20)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (20)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011921000, 1706011923000
    Run actions/checkout@v4 : 1706011923000, 1706011924000
    Use Node.js 20 : 1706011924000, 1706011927000
    Run npm install : 1706011927000, 1706011938000
    Run npm run postinstall : 1706011938000, 1706011938000
    Run git submodule init : 1706011938000, 1706011938000
    Run git submodule update : 1706011939000, 1706011940000
    Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1706011940000, 1706011952000
    Run sleep 5 : 1706011952000, 1706011957000
    Workflow Telemetry : 1706011957000, 1706011957000
    Run node qryn.mjs >/dev/stdout & : 1706011957000, 1706011962000
    Run npm run test --forceExit : 1706011963000, 1706011991000

CPU Metrics

chart_stacked_area_time_7c207a74-187f-4936-b6a1-0d9520fb2ca6

Memory Metrics

chart_stacked_area_time_f96488a2-f5dc-4816-8192-eb2e4c82b877

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (20)
    dateFormat x
    axisFormat %H:%M:%S
    bash : 1706011957588, 1706011957589
    bash : 1706011962603, 1706011991912
    npm : 1706011962605, 1706011991908
    node : 1706011962605, 1706011991908
    jest : 1706011962859, 1706011991904
    node : 1706011962859, 1706011991904
    node : 1706011963039, 1706011963067
    find : 1706011963259, 1706011963260
    find : 1706011963265, 1706011963446
    node : 1706011963466, 1706011963562
    node : 1706011963470, 1706011963555
    node : 1706011963473, 1706011963562
    node : 1706011963578, 1706011991851
    node : 1706011963580, 1706011991887
    node : 1706011963583, 1706011991879
    node : 1706011963668, 1706011963712
    node : 1706011963678, 1706011963728
    node : 1706011963687, 1706011963729

github-actions[bot] commented 8 months ago

Workflow Telemetry - QRYN CI / build (16.x)

Workflow telemetry for commit ce808c4bc4a58f796a5a1983d6ded4a469af25e6 You can access workflow job details here

Step Trace

gantt
    title build (16.x)
    dateFormat x
    axisFormat %H:%M:%S
    Set up job : milestone, 1706011919000, 1706011920000
    Run actions/checkout@v4 : 1706011920000, 1706011922000
    Use Node.js 16.x : 1706011922000, 1706011929000
    Run npm install : 1706011929000, 1706011940000
    Run npm run postinstall : 1706011940000, 1706011940000
    Run git submodule init : 1706011940000, 1706011940000
    Run git submodule update : 1706011941000, 1706011941000
    Run docker-compose -f docker/e2e/docker-compose-cluster.yaml up -d : 1706011942000, 1706011952000
    Run sleep 5 : 1706011952000, 1706011957000
    Workflow Telemetry : 1706011957000, 1706011957000
    Run node qryn.mjs >/dev/stdout & : 1706011958000, 1706011962000
    Run npm run test --forceExit : 1706011962000, 1706011992000

CPU Metrics

chart_stacked_area_time_bf0d01bc-ee62-42e4-b5ec-47d87d176b60

Memory Metrics

chart_stacked_area_time_a0da9c3d-7f01-4994-a0f2-d8d8386c0203

IO Metrics

	Read	Write
Network I/O
Disk I/O

Process Trace

Top 100 processes with highest duration

gantt
    title build (16.x)
    dateFormat x
    axisFormat %H:%M:%S
    bash : 1706011957731, 1706011957732
    bash : 1706011962748, 1706011992965
    npm : 1706011962750, 1706011992961
    node : 1706011962750, 1706011992961
    jest : 1706011963020, 1706011992955
    node : 1706011963020, 1706011992955
    node : 1706011963200, 1706011963235
    find : 1706011963449, 1706011963450
    find : 1706011963457, 1706011963639
    node : 1706011963663, 1706011963757
    node : 1706011963669, 1706011963758
    node : 1706011963675, 1706011963757
    node : 1706011963781, 1706011992916
    node : 1706011963786, 1706011992931
    node : 1706011963792, 1706011992936
    node : 1706011963875, 1706011963914
    node : 1706011963889, 1706011963941
    node : 1706011963892, 1706011963942