search

googleapis / google-cloud-ruby

Google Cloud Client Library for Ruby
https://googleapis.github.io/google-cloud-ruby/
Apache License 2.0
1.36k stars 550 forks source link

Bigquery gem fails to upload json > 5 MB #27349

Open kshitij6325 opened 1 month ago

kshitij6325 commented 1 month ago

Description

I am encountering an issue when attempting to insert a row with JSON content (28 MB) as field into BigQuery using the google-cloud-bigquery gem. When the JSON size exceeds 5MB, the operation fails with the following error:

HTTPClient::KeepAliveDisconnected: Broken pipe (HTTPClient::KeepAliveDisconnected)

The maximum field size supported by BigQuery is 100MB. The operation works fine when the JSON size is under 5MB.

Stacktrace

ruby-stacktrace.txt

Environment details