search

tremor-rs / tremor-runtime

Main Tremor Project Rust Codebase
https://www.tremor.rs
Apache License 2.0
857 stars 125 forks source link

Add experimental Microsoft Azure Monitor Log Ingest connector #2583

Closed darach closed 3 months ago

darach commented 3 months ago

Pull request

Description

Add experimental Microsoft Azure Monitor Log Ingest connector

Checklist

Performance

This is a net new experimental connector and may need tweaks based on live testing which is tbd

codecov[bot] commented 3 months ago

Codecov Report

Attention: Patch coverage is 90.47120% with 91 lines in your changes missing coverage. Please review.

Project coverage is 91.35%. Comparing base (6bb76a4) to head (d917aef).

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/graphs/tree.svg?width=650&height=150&src=pr&token=d1bhuZGcOK&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs)](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) ```diff @@ Coverage Diff @@ ## main #2583 +/- ## ========================================== + Coverage 83.93% 91.35% +7.42% ========================================== Files 298 308 +10 Lines 53198 60109 +6911 ========================================== + Hits 44653 54915 +10262 + Misses 8545 5194 -3351 ``` | [Flag](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | Coverage Δ | | |---|---|---| | [e2e-command](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `11.23% <0.00%> (-0.14%)` | :arrow_down: | | [e2e-integration](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `51.86% <2.47%> (-0.42%)` | :arrow_down: | | [e2e-unit](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `12.45% <0.00%> (-0.15%)` | :arrow_down: | | [e2etests](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `54.18% <2.47%> (-0.45%)` | :arrow_down: | | [tremorapi](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `14.34% <1.44%> (-0.36%)` | :arrow_down: | | [tremorcodec](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `62.94% <0.00%> (-0.11%)` | :arrow_down: | | [tremorcommon](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `63.15% <96.29%> (+1.30%)` | :arrow_up: | | [tremorconnectors](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `28.60% <33.33%> (?)` | | | [tremorconnectorsaws](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `11.48% <0.00%> (?)` | | | [tremorconnectorsazure](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `5.03% <89.27%> (?)` | | | [tremorconnectorsgcp](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `21.28% <0.00%> (?)` | | | [tremorconnectorsobjectstorage](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `0.00% <0.00%> (ø)` | | | [tremorconnectorsotel](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `12.67% <0.00%> (?)` | | | [tremorconnectorstesthelpers](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `60.56% <ø> (ø)` | | | [tremorinflux](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `87.72% <ø> (ø)` | | | [tremorinterceptor](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `53.73% <0.00%> (-0.12%)` | :arrow_down: | | [tremorpipeline](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `31.06% <0.00%> (-0.02%)` | :arrow_down: | | [tremorruntime](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `46.64% <1.44%> (-0.53%)` | :arrow_down: | | [tremorscript](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `54.26% <0.00%> (-0.03%)` | :arrow_down: | | [tremorsystem](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `5.75% <0.00%> (-0.01%)` | :arrow_down: | | [tremorvalue](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `70.24% <0.00%> (-0.22%)` | :arrow_down: | | [unittests](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `88.32% <90.47%> (+18.27%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | Coverage Δ | | |---|---|---| | [src/lib.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=src%2Flib.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-c3JjL2xpYi5ycw==) | `100.00% <100.00%> (ø)` | | | [tremor-connectors-azure/src/lib.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors-azure%2Fsrc%2Flib.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtYXp1cmUvc3JjL2xpYi5ycw==) | `100.00% <100.00%> (ø)` | | | [...nnectors-azure/src/monitor/ingest/writer/source.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors-azure%2Fsrc%2Fmonitor%2Fingest%2Fwriter%2Fsource.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtYXp1cmUvc3JjL21vbml0b3IvaW5nZXN0L3dyaXRlci9zb3VyY2UucnM=) | `100.00% <100.00%> (ø)` | | | [tremor-connectors-azure/src/rest.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors-azure%2Fsrc%2Frest.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtYXp1cmUvc3JjL3Jlc3QucnM=) | `100.00% <100.00%> (ø)` | | | [tremor-connectors/src/impls/http/client.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fhttp%2Fclient.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2h0dHAvY2xpZW50LnJz) | `96.52% <100.00%> (+4.88%)` | :arrow_up: | | [tremor-connectors/src/impls/http/meta.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fhttp%2Fmeta.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2h0dHAvbWV0YS5ycw==) | `89.10% <100.00%> (+7.92%)` | :arrow_up: | | [tremor-connectors/src/impls/http/server.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fhttp%2Fserver.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2h0dHAvc2VydmVyLnJz) | `92.43% <100.00%> (+5.10%)` | :arrow_up: | | [tremor-connectors/src/source.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fsource.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL3NvdXJjZS5ycw==) | `88.15% <ø> (+2.20%)` | :arrow_up: | | [tremor-common/src/url.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-common%2Fsrc%2Furl.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbW1vbi9zcmMvdXJsLnJz) | `87.50% <96.29%> (+2.79%)` | :arrow_up: | | [tremor-connectors-azure/src/auth.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree&filepath=tremor-connectors-azure%2Fsrc%2Fauth.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtYXp1cmUvc3JjL2F1dGgucnM=) | `95.70% <95.70%> (ø)` | | | ... and [2 more](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | | ... and [71 files with indirect coverage changes](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) ------ [Continue to review full report in Codecov by Sentry](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?dropdown=coverage&src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). Last update [6bb76a4...d917aef](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2583?dropdown=coverage&src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs).
darach commented 3 months ago

Well, it might be nice work when I fix that merge conflict that crept in 🤓