Dataset: migrate 2.5TB to Goolge (GCS)

reconstrue / brightfield

Reconstruction of biocytin-stained neurons detected in brightfield microscopy image stacks

http://reconstrue.com

Apache License 2.0

2 stars 1 forks source link

Open JohnTigue opened 5 years ago

JohnTigue commented 5 years ago

Consider

Google was a sponsor of BioImage 2019
The dataset resides on Wasabi, which mimics AWS's S3's APIs
This project implements all code as Python on Colab
The dataset would load quicker on Colab if the dataset were in Google Cloud Storage (GCS

That's a pretty legitimate use of Google subsidized research credits.

JohnTigue commented 5 years ago

This actually would be important for the GPU implementations. The GPU will be able to load the dataset from GCS much faster.