sijocherian / google-bigquery

Automatically exported from code.google.com/p/google-bigquery
0 stars 0 forks source link

Load job with gs://xxx files get "Backend error" #236

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago
What steps will reproduce the problem?
1. bq load  --source_format NEWLINE_DELIMITED_JSON MY_TABLE 
gs://MYBUCKET/xxxx.log.gz
2. Job returned "Errors encountered during job execution. Backend error. Job 
aborted.".

I checked "bq show -j xxxx" command.

bq show -j bqjob_r434c831b03e8f78c_0000014cb1821bef_1 Job MYPROJ:bqjob_r434c831b03e8f78c_0000014cb1821bef_1

Job Type State Start Time Duration Bytes Processed


load FAILURE 13 Apr 15:40:50 0:39:38

Errors encountered during job execution. Backend error. Job aborted.


I started 144 bq load jobs for several days then about 30 jobs are "Backend 
error".

Some job ids
- bqjob_r434c831b03e8f78c_0000014cb1821bef_1
- bqjob_rb74283cf47cd711_0000014cb15667cc_1

Also I found next behaviors

- Once "Backend error" returned, bq load job with same file returned always 
"Backend error". 
- Download the file caused "Backend error" by [gsutil cp 
gs://MUBUCKET/xxxx.log.gz ./] command and [bq load] with downloaded file, it 
succeed.

Original issue reported on code.google.com by Takashi_...@voyagegroup.com on 13 Apr 2015 at 9:50

GoogleCodeExporter commented 8 years ago
https://cloud.google.com/bigquery/troubleshooting-errors
This document says "backendError 503 This error returns when there is a 
temporary server failure such as a network connection problem or a server 
overload.".
But I have never see the "Backend Error" fixed. I retry the job, and I got 
backendError every time.

Original comment by Takashi_...@voyagegroup.com on 24 Apr 2015 at 5:24