Support for Google Cloud Storage

dmlc / dmlc-core

A common bricks library for building scalable and portable distributed machine learning.

Apache License 2.0

863 stars 518 forks source link

Support for Google Cloud Storage #14

Open tqchen opened 9 years ago

tqchen commented 9 years ago

Support for google cloud storage can be done similarly as https://github.com/dmlc/dmlc-core/blob/master/src/io/s3_filesys.cc via rest API

It could involve a refactor of s3 filesys to be a general base, which take s3 and gcs as child class. Guess similar thing could also be done to support Azure's cloud.

Anyone who is interested in claim this is welcomed to reply on this thread

chenqin commented 5 years ago

will take a look

dmedora commented 1 year ago

Is there a particular reason this should be done using the REST API rather than the GCS client library? This would probably be a much cleaner approach.