Closed r1walz closed 8 months ago
1 org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=pit/10_basic/Delete all}
1 org.opensearch.indices.replication.SegmentReplicationIT.testScrollCreatedOnReplica
1 org.opensearch.indices.replication.SegmentReplicationIT.classMethod
Merging #8716 (0663f12) into main (91f9c5d) will decrease coverage by
0.09%
. The diff coverage is71.25%
.
@@ Coverage Diff @@
## main #8716 +/- ##
============================================
- Coverage 71.21% 71.13% -0.09%
- Complexity 58256 58269 +13
============================================
Files 4830 4830
Lines 274509 274575 +66
Branches 40004 40015 +11
============================================
- Hits 195495 195314 -181
- Misses 62634 62912 +278
+ Partials 16380 16349 -31
Files | Coverage Δ | |
---|---|---|
...main/java/org/opensearch/core/rest/RestStatus.java | 97.33% <100.00%> (+8.14%) |
:arrow_up: |
.../opensearch/index/shard/InternalIndexingStats.java | 87.50% <100.00%> (ø) |
|
...in/java/org/opensearch/indices/IndicesService.java | 70.64% <100.00%> (-0.35%) |
:arrow_down: |
...rg/opensearch/action/bulk/TransportBulkAction.java | 76.79% <94.44%> (+0.36%) |
:arrow_up: |
...java/org/opensearch/index/shard/IndexingStats.java | 86.61% <81.81%> (+2.30%) |
:arrow_up: |
...pensearch/action/update/TransportUpdateAction.java | 4.24% <0.00%> (-0.34%) |
:arrow_down: |
Compatibility status:
> Task :checkCompatibility
Checking compatibility for: https://github.com/opensearch-project/reporting.git with ref: main
Incompatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git]
Compatible components: [https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
BUILD SUCCESSFUL in 32m 29s
1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testRequestStats
Checks if related components are compatible with change 0663f12
Compatible components: [https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change 30f5d9c
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
Checks if related components are compatible with change 0be448e
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
1 org.opensearch.search.SearchWeightedRoutingIT.testMultiGetWithNetworkDisruption_FailOpenEnabled
Checks if related components are compatible with change 0fde110
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
1 org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=pit/10_basic/Delete all}
Checks if related components are compatible with change 245f58f
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
Checks if related components are compatible with change da8837c
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
Gradle check is failing. Could you please check?
Gradle check is failing. Could you please check?
It was a flaky test. It passed earlier and offline too.
Other than that there's a check for low coverage that's failing.
Rerunning gradle.
Checks if related components are compatible with change 6fb5f2e
Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
1 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testTaskResourceTrackingDuringTaskCancellation
Checks if related components are compatible with change 85d7bb2
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
Checks if related components are compatible with change 831274e
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change b0f9674
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change 343b709
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change e3365c8
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change dbdd36f
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]
Checks if related components are compatible with change 533ba11
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]
Description
Currently, Opensearch returns a 200 OK response code for a Bulk API call, even though there can be partial/complete failures within the request E2E. Tracking these failures requires client to parse the response on their side and make sense of them. But, a general idea around trend in growth of different rest status codes at item level can provide insights on how indexing engine is performing.
Related Issues
Resolves #4562
Check List
Benchmarks!
# DocStatusCounter Benchmarking **Configuration:** - 3 Data Nodes: r6g.4xlarge - 3 Manager Nodes: c6g.2xlarge - Heap: 64 GB - Indexed 160,000,000 (160M) docs using [opensearch-benchmark](https://github.com/opensearch-project/opensearch-benchmark) - CPU Utilization > 90% each run |Metric |Unit |Task |String Keys |Baseline |Short Keys |ThreadLocalMap|AtomicLong[] |-|-|-|-|-|-|-|-| | Cumulative indexing time of primary shards |min | |185.26433 |173.42567 |176.12467 |176.21833|169.801 | Min cumulative indexing time across primary shards |min | |6.67E-05 |55.43687 |55.61673 |56.04497|55.348 | Median cumulative indexing time across primary shards |min | |59.04873 |57.10593 |58.50937 |58.2993|55.5361 | Max cumulative indexing time across primary shards |min | |67.16667 |60.88293 |61.9988 |61.87413|58.917 | Cumulative indexing throttle time of primary shards |min | |0 |0 |0 |0|0 | Min cumulative indexing throttle time across primary shards |min | |0 |0 |0 |0|0 | Median cumulative indexing throttle time across primary shards |min | |0 |0 |0 |0|0 | Max cumulative indexing throttle time across primary shards |min | |0 |0 |0 |0|0 | Cumulative merge time of primary shards |min | |53.6561 |53.96897 |51.88953 |55.65487|47.0504 | Cumulative merge count of primary shards | | |113.33333 |107.33333 |105.66667 |107.66667|105 | Min cumulative merge time across primary shards |min | |0 |16.16687 |16.6941 |16.01773|12.6753 | Median cumulative merge time across primary shards |min | |17.10093 |18.38877 |16.9021 |18.06377|17.0686 | Max cumulative merge time across primary shards |min | |19.45427 |19.41333 |18.2934 |21.57333|17.3066 | Cumulative merge throttle time of primary shards |min | |14.49533 |16.94427 |14.9402 |16.39743|12.676 | Min cumulative merge throttle time across primary shards |min | |0 |4.72383 |4.03366 |4.01268|3.78305 | Median cumulative merge throttle time across primary shards |min | |4.3005 |5.36746 |5.16321 |5.4102|4.10685 | Max cumulative merge throttle time across primary shards |min | |5.89435 |6.85298 |5.74337 |6.97451|4.78612 | Cumulative refresh time of primary shards |min | |4.53589 |4.42749 |4.32285 |4.26004|4.27837 | Cumulative refresh count of primary shards | | |143 |126.66667 |126.33333 |128.66667|120 | Min cumulative refresh time across primary shards |min | |0.00018 |1.39173 |1.35457 |1.32311|1.41253 | Median cumulative refresh time across primary shards |min | |1.48191 |1.43236 |1.46172 |1.4063|1.41697 | Max cumulative refresh time across primary shards |min | |1.57189 |1.6034 |1.50656 |1.53063|1.44887 | Cumulative flush time of primary shards |min | |2.12778 |2.24693 |2.20361 |2.09975|2.38865 | Cumulative flush count of primary shards | | |31.33333 |30.66667 |28.66667 |29.33333|28 | Min cumulative flush time across primary shards |min | |0.00015 |0.65804 |0.62011 |0.62618|0.75745 | Median cumulative flush time across primary shards |min | |0.68019 |0.77672 |0.75957 |0.67874|0.7731 | Max cumulative flush time across primary shards |min | |0.76725 |0.81217 |0.82393 |0.79483|0.8581 | Total Young Gen GC time |s | |38.75267 |34.86833 |36.069 |33.21967|36.447 | Total Young Gen GC count |s | |502 |486.33333 |495.66667 |447|542 | Total Old Gen GC time |GB | |0 |0 |0 |0|0 | Total Old Gen GC count |GB | |0 |0 |0 |0|0 | Store size |MB | |63.48167 |52.1122 |57.52483 |52.37343|72.8811 | Translog size |MB | |5.63E-07 |4.61E-07 |4.61E-07 |4.61E-07|4.61E-07 | Heap used for segments |MB | |0 |0 |0 |0|0 | Heap used for doc values |MB | |0 |0 |0 |0|0 | Heap used for terms |MB | |0 |0 |0 |0|0 | Heap used for norms |MB | |0 |0 |0 |0|0 | Heap used for points | | |0 |0 |0 |0|0 | Heap used for stored fields |docs/s |index |0 |0 |0 |0|0 | Segment count |docs/s |index |86 |89.33333 |88.33333 |85.33333|73 | Min Throughput |docs/s |index |188963 |190996.66667 |188393.66667 |202766|168622 | Mean Throughput |ms |index |202721.66667 |215656.33333 |212218 |213985|219714 | Median Throughput |ms |index |199066.33333 |214909 |210353 |211633.66667|220747 | Max Throughput |ms |index |243293.66667 |241402.66667 |240322 |247813|229924 | 50th percentile latency |ms |index |4956.15667 |4532.03 |4584.96667 |4653.31333|4191.51 | 90th percentile latency |ms |index |7005.88667 |6453.49333 |6649.78 |6524.09667|6210.21 | 99th percentile latency |ms |index |9844.68333 |9437.39333 |9771.28 |9136.64667|9669.73 | 99.9th percentile latency |ms |index |11722.83333 |11428.73333 |11919.23333 |10853.76667|12189.8 | 100th percentile latency |ms |index |13378.36667 |13292.16667 |13863.46667 |11733.63333|12971.5 | 50th percentile service time |ms |index |4956.15667 |4532.03 |4584.96667 |4653.31333|4191.51 | 90th percentile service time |ms |index |7005.88667 |6453.49333 |6649.78 |6524.09667|6210.21 | 99th percentile service time |ms |index |9844.68333 |9437.39333 |9771.28 |9136.64667|9669.73 | 99.9th percentile service time |ms | |11722.83333 |11428.73333 |11919.23333 |10853.76667|12189.8 | 100th percentile service time |ms | |13378.36667 |13292.16667 |13863.46667 |11733.63333|12971.5 | error rate |% | |0 |0 |0 |0|0By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.