coinbase / chainstorage

The File System For a Multi-Blockchain World
https://time-wilderness-a70.notion.site/ChainStorage-5c173d1cafd842ceb9e38c26bfbd6265?pvs=4
Apache License 2.0
68 stars 24 forks source link

Native Google Cloud Platform (GCP) Support #90

Open namanjain opened 4 months ago

namanjain commented 4 months ago

We’ve been running Chainstorage on AWS and it’s been working out great so far. However, most of our infrastructure is on GCP. It would be great if Chainstorage could natively support GCP in addition to AWS. Are there any such plans in the pipeline? It would be a game changer for us and also expand its usability for a broader audience.

If there is any room for collaboration, we are open to contributing to the codebase and documentation.

leozc commented 4 months ago

@bestmike007 is working on this

bestmike007 commented 4 months ago

@namanjain it's WIP, not production ready but you can give it a try with the following config:

storage_type:
  meta: FIRESTORE
  blob: GCS
  dlq: FIRESTORE
aws:
  local_stack: false
gcp:
  project: your-chainstorage-project
  bucket: your-chainstorage-blob-bucket

You can use the ADC to authenticate the chainstorage processes. The default firestore database and one GCS bucket is required, and the firestore database can be configured using the firebase cli with the configurations in https://github.com/coinbase/chainstorage/tree/master/scripts/firebase

Documents will be updated later, and we welcome all kinds of contributions.