search

wal-g / wal-g

Archival and Restoration for databases in the Cloud
Other
3.26k stars 459 forks source link

how to use obs or oss replace aws s3? #1410

Closed wonb168 closed 1 year ago

wonb168 commented 1 year ago

Database name

greenplum 6.12

Issue description

Describe your problem

example is aws s3, but we use aliyun oss or huawei cloud obs, then how to change the config file:

PGDATABASE: "postgres"
WALE_S3_PREFIX: "s3://some/s3/prefix/"
WALG_NETWORK_RATE_LIMIT: 8388608
PGPASSFILE: "/home/gpadmin/.pgpass"
WALG_GP_LOGS_DIR: "/var/log/greenplum"
AWS_ACCESS_KEY_ID: "aws_access_key_id"
WALG_UPLOAD_CONCURRENCY: 5
WALG_PGP_KEY_PATH: "/path/to/PGP_KEY"
WALG_DOWNLOAD_CONCURRENCY: 5
WALE_GPG_KEY_ID: "gpg_key_id"
WALG_DISK_RATE_LIMIT: 167772160
PGUSER: "gpadmin"
GOMAXPROCS: 6
PGHOST: "localhost"
AWS_ENDPOINT: "https://s3-endpoint.host.name"
AWS_SECRET_ACCESS_KEY: "aws_secret_access_key"
WALG_COMPRESSION_METHOD: "brotli"

Please provide steps to reproduce

// it can really help

usernamedt commented 1 year ago

Hi! If these object storages are not S3-compatible, you need to implement a new storage.