Tensorflow Datasets Loading to GCS fails

Short description TFDS is failing while loading dataset on GCS. For smaller datasets like MNIST, there's no error and the code just runs fine. however for bigger datasets like "Coco2014", "imagenet" and "Open Images v4", the process stops, and gives the following error in the JSON Response.

Error: 500 Backend Error. Error Uploading to gs://bucket_name/path/to/store. Retrying Upload.

Environment information

Operating System: Debian 9
Python version: 3.6
System Memory: 16 Gigs
Free space in Secondary Storage: ~ 900 Gigs
tensorflow-datasets/tfds-nightly version: tfds-nightly==1.0.2.dev201906200105
tensorflow/tensorflow-gpu/tf-nightly/tf-nightly-gpu version: tensorflow==2.0.0b0

Reproduction instructions

import tensorflow_datasets as tfds
ds = tfds.load("open_images_v4", data_dir="gs://bucket/path") # Fails
ds = tfds.load("coco2014", data_dir="gs://bucket/path") # Fails
ds = tfds.load("imagenet", data_dir="gs://bucket/path") # Fails
ds = tfds.load("mnist", data_dir="gs://bucket/path") # Works fine

Logs

2019-07-05 03:26:19.998078: I tensorflow/core/platform/cloud/retrying_utils.cc:73] The operation failed and will be automatically retried in 0.35809 seconds (attempt 1 out of 10), caused by: Unavailable: Upload to gs://rickdey1998/data_dir/downloads/extracted/ZIP.images.cocodataset.org_zips_val2014_pvoFgUgScNHF-B32eNKpggUpVZ5-ATNBD48vuO5_eA.zip.incomplete_71bc721e170542848983123a225ba268/val2014/COCO_val2014_000000047149.jpg failed, caused by: Not found: Error executing an HTTP request: HTTP response code 410 with body '{

 "error": {

  "errors": [

   {

    "domain": "global",

    "reason": "backendError",

    "message": "Backend Error"

   }

  ],

  "code": 500,

  "message": "Backend Error"

 }

}

'

         when resuming upload gs://rickdey1998/data_dir/downloads/extracted/ZIP.images.cocodataset.org_zips_val2014_pvoFgUgScNHF-B32eNKpggUpVZ5-ATNBD48vuO5_eA.zip.incomplete_71bc721e170542848983123a225ba268/val2014/COCO_val2014_000000047149.jpg

Expected behavior No error with larger datasets, and the dataset gets loaded on GCS, without any error, like any other smaller datasets.

Steps Already Taken

Updated Tensorflow Datasets
Contacted Cloud Support: They Said there's nothing wrong on their end.

CCs: @vbardiovskyg @srjoglekar246

@rsepassi @Conchylicultor @cyfra

tensorflow / datasets

Tensorflow Datasets Loading to GCS fails #740