Altinity / clickhouse-backup

Tool for easy backup and restore for ClickHouse® using object storage for backup files.
https://altinity.com
Other
1.29k stars 226 forks source link

Whether Huawei OBS is supported? #986

Closed liubo-it closed 2 months ago

liubo-it commented 3 months ago

Whether data can be backed up to HuaWei obs? @Slach

Slach commented 3 months ago

directly not

looks like OBS is S3 compatible storage

try

general:
  remote_storage: s3
s3:
   ...  

and report logs here if some issues happens

Slach commented 3 months ago

do you success with s3 for Huawei OBS?

liubo-it commented 2 months ago

do you success with s3 for Huawei OBS?

I'm sorry I just saw it.

I tried to use S3 protocol to use Huawei OBS can work.

Thank you for your help.

Slach commented 2 months ago

Could you provide worked config s3 section without sensitive credentials for who next time will search?

liubo-it commented 2 months ago

Could you provide worked config s3 section without sensitive credentials for who next time will search?

ok,Configure as follows

s3:
  access_key: "xxx"
  secret_key: "xxx"
  bucket: "xxx"
  endpoint: "https://xxx.huaweicloud.com"
  region:
  acl: private
  assume_role_arn: ""
  force_path_style: false
  path: "/"
  disable_ssl: false
  compression_level: 1
  compression_format: tar
  sse: ""
  disable_cert_verification: false
  use_custom_storage_class: false
  storage_class: STANDARD
  concurrency: 4
  part_size: 536870912
  max_parts_count: 10000
  allow_multipart_download: true
  debug: false
Slach commented 2 months ago

better remove part_size and use max_parts_count: 4000 it could improve upload/download speed

liubo-it commented 2 months ago

better remove part_size and use max_parts_count: 4000 it could improve upload/download speed

Ok, I'll try

thx