search

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.67k stars 4.19k forks source link

Add options to control number of Storage API connections when using multiplexing #31721

Open ahmedabu98 opened 2 days ago

ahmedabu98 commented 2 days ago

Controls min and max number of connections to connection pool. For more details on this BigQuery Storage Write API feature, see https://cloud.google.com/bigquery/docs/write-api-best-practices#connection_pool_management

ahmedabu98 commented 2 days ago

R: @gaolemeng R: @agrawal-siddharth

CC: @reuvenlax CC: @damccorm

github-actions[bot] commented 2 days ago

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

codecov[bot] commented 1 day ago

Codecov Report

Attention: Patch coverage is 36.36364% with 7 lines in your changes missing coverage. Please review.

Project coverage is 71.18%. Comparing base (c3756c0) to head (3801412). Report is 1 commits behind head on master.

Files Patch % Lines
...beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java 0.00% 7 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #31721 +/- ## ============================================ - Coverage 71.18% 71.18% -0.01% Complexity 3019 3019 ============================================ Files 1058 1058 Lines 134254 134261 +7 Branches 3257 3257 ============================================ + Hits 95571 95572 +1 - Misses 35536 35542 +6 Partials 3147 3147 ``` | [Flag](https://app.codecov.io/gh/apache/beam/pull/31721/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | |---|---|---| | [java](https://app.codecov.io/gh/apache/beam/pull/31721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `69.59% <36.36%> (-0.02%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.