search

scality / backbeat

Zenko Backbeat is the core engine for asynchronous replication, optimized for queuing metadata updates and dispatching work to long-running tasks in the background.
https://www.zenko.io
Apache License 2.0
55 stars 19 forks source link

Log consumer lag metrics #2563

Closed KillianG closed 1 week ago

KillianG commented 1 month ago

Issue: BB-561

bert-e commented 1 month ago

Hello killiang,

My role is to assist you with the merge of this pull request. Please type @bert-e help to get information on this process, or consult the user documentation.

Available options name | description | privileged | authored ------ | ------------ | ------------ |---------- `/after_pull_request` | Wait for the given pull request id to be merged before continuing with the current one. | | `/bypass_author_approval` | Bypass the pull request author's approval | :star: | `/bypass_build_status` | Bypass the build and test status | :star: | `/bypass_commit_size` | Bypass the check on the size of the changeset ```TBA``` | :star: | `/bypass_incompatible_branch` | Bypass the check on the source branch prefix | :star: | `/bypass_jira_check` | Bypass the Jira issue check | :star: | `/bypass_peer_approval` | Bypass the pull request peers' approval | :star: | `/bypass_leader_approval` | Bypass the pull request leaders' approval | :star: | `/approve` | Instruct Bert-E that the author has approved the pull request. | | :writing_hand: `/create_pull_requests` | Allow the creation of integration pull requests. | | `/create_integration_branches` | Allow the creation of integration branches. | | `/no_octopus` | Prevent Wall-E from doing any octopus merge and use multiple consecutive merge instead | | `/unanimity` | Change review acceptance criteria from `one reviewer at least` to `all reviewers` | | `/wait` | Instruct Bert-E not to run until further notice. | |
Available commands name | description | privileged ------ | ------------ | ------------ `/help` | Print Bert-E's manual in the pull request. | `/status` | Print Bert-E's current status in the pull request ```TBA``` | `/clear` | Remove all comments from Bert-E from the history ```TBA``` | `/retry` | Re-start a fresh build ```TBA``` | `/build` | Re-start a fresh build ```TBA``` | `/force_reset` | Delete integration branches & pull requests, and restart merge process from the beginning. | `/reset` | Try to remove integration branches unless there are commits on them which do not appear on the source branch. |

Status report is not available.

bert-e commented 1 month ago

Incorrect fix version

The Fix Version/s in issue BB-561 contains:

Considering where you are trying to merge, I ignored possible hotfix versions and I expected to find:

Please check the Fix Version/s of BB-561, or the target branch of this pull request.

codecov[bot] commented 1 month ago

Codecov Report

Attention: Patch coverage is 65.11628% with 15 lines in your changes missing coverage. Please review.

Project coverage is 70.28%. Comparing base (e297638) to head (b02839b). Report is 36 commits behind head on development/8.7.

Files with missing lines Patch % Lines
...ions/notification/queueProcessor/QueueProcessor.js 60.00% 4 Missing :warning:
...sions/replication/queueProcessor/QueueProcessor.js 33.33% 4 Missing :warning:
...ationStatusProcessor/ReplicationStatusProcessor.js 42.85% 4 Missing :warning:
lib/BackbeatConsumer.js 85.00% 3 Missing :warning:
Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/scality/backbeat/pull/2563/graphs/tree.svg?width=650&height=150&src=pr&token=LlNB6ANurP&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality)](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | [Files with missing lines](https://app.codecov.io/gh/scality/backbeat/pull/2563?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | Coverage Δ | | |---|---|---| | [lib/constants.js](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&filepath=lib%2Fconstants.js&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#diff-bGliL2NvbnN0YW50cy5qcw==) | `100.00% <ø> (ø)` | | | [lib/BackbeatConsumer.js](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&filepath=lib%2FBackbeatConsumer.js&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#diff-bGliL0JhY2tiZWF0Q29uc3VtZXIuanM=) | `89.92% <85.00%> (-1.12%)` | :arrow_down: | | [...ions/notification/queueProcessor/QueueProcessor.js](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&filepath=extensions%2Fnotification%2FqueueProcessor%2FQueueProcessor.js&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#diff-ZXh0ZW5zaW9ucy9ub3RpZmljYXRpb24vcXVldWVQcm9jZXNzb3IvUXVldWVQcm9jZXNzb3IuanM=) | `57.01% <60.00%> (+0.28%)` | :arrow_up: | | [...sions/replication/queueProcessor/QueueProcessor.js](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&filepath=extensions%2Freplication%2FqueueProcessor%2FQueueProcessor.js&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#diff-ZXh0ZW5zaW9ucy9yZXBsaWNhdGlvbi9xdWV1ZVByb2Nlc3Nvci9RdWV1ZVByb2Nlc3Nvci5qcw==) | `72.20% <33.33%> (-0.76%)` | :arrow_down: | | [...ationStatusProcessor/ReplicationStatusProcessor.js](https://app.codecov.io/gh/scality/backbeat/pull/2563?src=pr&el=tree&filepath=extensions%2Freplication%2FreplicationStatusProcessor%2FReplicationStatusProcessor.js&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#diff-ZXh0ZW5zaW9ucy9yZXBsaWNhdGlvbi9yZXBsaWNhdGlvblN0YXR1c1Byb2Nlc3Nvci9SZXBsaWNhdGlvblN0YXR1c1Byb2Nlc3Nvci5qcw==) | `67.26% <42.85%> (-1.07%)` | :arrow_down: | ... and [2 files with indirect coverage changes](https://app.codecov.io/gh/scality/backbeat/pull/2563/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | [Components](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | Coverage Δ | | |---|---|---| | [Bucket Notification](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `66.53% <60.00%> (-0.14%)` | :arrow_down: | | [Core Library](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `75.14% <85.00%> (-0.08%)` | :arrow_down: | | [Ingestion](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `69.24% <ø> (ø)` | | | [Lifecycle](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `76.20% <ø> (-0.04%)` | :arrow_down: | | [Oplog Populator](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `82.95% <ø> (ø)` | | | [Replication](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `57.68% <38.46%> (-0.12%)` | :arrow_down: | | [Bucket Scanner](https://app.codecov.io/gh/scality/backbeat/pull/2563/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `85.60% <ø> (ø)` | | ```diff @@ Coverage Diff @@ ## development/8.7 #2563 +/- ## =================================================== - Coverage 70.35% 70.28% -0.08% =================================================== Files 194 194 Lines 12997 13039 +42 =================================================== + Hits 9144 9164 +20 - Misses 3843 3865 +22 Partials 10 10 ``` | [Flag](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | Coverage Δ | | |---|---|---| | [api:retry](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `9.69% <0.00%> (-0.04%)` | :arrow_down: | | [api:routes](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `9.50% <0.00%> (-0.04%)` | :arrow_down: | | [bucket-scanner](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `85.60% <ø> (ø)` | | | [ingestion](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `12.42% <2.32%> (-0.03%)` | :arrow_down: | | [lib](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `7.64% <39.53%> (+0.10%)` | :arrow_up: | | [lifecycle](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `19.20% <9.30%> (-0.05%)` | :arrow_down: | | [notification](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `0.87% <0.00%> (-0.01%)` | :arrow_down: | | [replication](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `19.04% <20.93%> (+0.01%)` | :arrow_up: | | [unit](https://app.codecov.io/gh/scality/backbeat/pull/2563/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality) | `46.56% <34.88%> (-0.05%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=scality#carryforward-flags-in-the-pull-request-comment) to find out more.
KillianG commented 1 week ago

/approve

bert-e commented 1 week ago

In the queue

The changeset has received all authorizations and has been added to the relevant queue(s). The queue(s) will be merged in the target development branch(es) as soon as builds have passed.

The changeset will be merged in:

The following branches will NOT be impacted:

There is no action required on your side. You will be notified here once the changeset has been merged. In the unlikely event that the changeset fails permanently on the queue, a member of the admin team will contact you to help resolve the matter.

IMPORTANT

Please do not attempt to modify this pull request.

If you need this pull request to be removed from the queue, please contact a member of the admin team now.

The following options are set: approve

bert-e commented 1 week ago

I have successfully merged the changeset of this pull request into targetted development branches:

The following branches have NOT changed:

Please check the status of the associated issue BB-561.

Goodbye killiang.