🐛 firestore-bigquery-export Unhandled error ApiError: Cannot parse response as JSON:

madmacc commented 2 months ago

[REQUIRED] Step 2: Describe your configuration

Extension name: firestore-bigquery-export
Extension version: 0.1.33
Configuration values (redact info where appropriate): BigQuery Dataset location us-east1 Project Id myprojectid Collection path memberStatusChangeLogs Enable Wildcard Column field with Parent Firestore Document IDs (Optional) false Dataset ID mydsid Table ID memberStatusChangeLogs BigQuery SQL table Time Partitioning option type (Optional) NONE BigQuery Time Partitioning column name (Optional) Parameter not set Firestore Document field name for BigQuery SQL Time Partitioning field option (Optional) Parameter not set BigQuery SQL Time Partitioning table schema field(column) type (Optional) omit BigQuery SQL table clustering (Optional) Parameter not set Maximum number of synced documents per second (Optional) Parameter not set Backup Collection Name (Optional) Parameter not set Transform function URL (Optional) Parameter not set Use new query syntax for snapshots yes Enabled events This extension has no events enabled. If you want to enable events, reconfigure the extension.

[REQUIRED] Step 3: Describe the problem

This has been working fine for a while but on 2024-04-22 I just started getting this error:

Unhandled error ApiError: Cannot parse response as JSON: <!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 502 (Server Error)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>502.</b> <ins>That’s an error.</ins>
  <p>The server encountered a temporary error and could not complete your request.<p>Please try again in 30 seconds.  <ins>That’s all we know.</ins>

    at Util.parseHttpRespBody (/workspace/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/node_modules/@google-cloud/common/build/src/util.js:188:42)
    at Util.handleResp (/workspace/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/node_modules/@google-cloud/common/build/src/util.js:134:117)
    at /workspace/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/node_modules/@google-cloud/common/build/src/util.js:432:22
    at onResponse (/workspace/node_modules/retry-request/index.js:228:7)
    at /workspace/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/node_modules/teeny-request/build/src/index.js:233:13
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
  response: PassThrough {
    _readableState: ReadableState {
… [message truncated due to size]

Steps to reproduce:

No changes to the process this just started to occur and is only occurring sometimes. Other collections running this extension seem to be ok.

Expected result

Copies the data to BQ without an error.

Actual result

Has an error and does not copy data to BQ.

cabljac commented 2 months ago

Hey, this is quite an outdated version of the extension, can you update to the current version (0.1.49) and see if the problem persists?

luke-rogers commented 1 week ago

I am seeing this on the latest version of the extension.

firebase / extensions