grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
23.39k stars 3.39k forks source link

Integrate Alibaba Cloud oss #5499

Closed tscuite closed 2 years ago

tscuite commented 2 years ago

Will there be any plans to integrate Alibaba Cloud's object storage oss?

kavirajk commented 2 years ago

@tscuite we don't have any such immediate plans. But discussions, PRs and contributions are more than welcome :)

tscuite commented 2 years ago

I will read the source code carefully,learn, learn

suraciii commented 2 years ago

Just use aws/s3 store, AliOSS supports s3 compatible api.

storage_config:
  aws:
    bucketnames:
    endpoint:
    access_key_id:
    secret_access_key:
    insecure: true
}

Notice insecure: true is necessary because AliOSS doesn't support chunked uploads.

tscuite commented 2 years ago

I'll check if all APIs are compatible when I'm free https://help.aliyun.com/document_detail/64919.html#title-cds-fai-yxp

liguozhong commented 2 years ago

this pr: https://github.com/grafana/loki/pull/5522

schema_config:
  configs:
  - from: 2020-05-15
    object_store: oss
    schema: v11
    index:
      prefix: loki_index_
      period: 168h

storage_config:
  alibaba:
    bucket: loki-chunk-test
    endpoint: oss-cn-beijing.aliyuncs.com
    access_key_id: <ak>
    secret_access_key: <sk>
tscuite commented 2 years ago

this pr: #5522

schema_config:
  configs:
  - from: 2020-05-15
    object_store: oss
    schema: v11
    index:
      prefix: loki_index_
      period: 168h

storage_config:
  alibaba:
    bucket: loki-chunk-test
    endpoint: oss-cn-beijing.aliyuncs.com
    access_key_id: <ak>
    secret_access_key: <sk>

very nice

stale[bot] commented 2 years ago

Hi! This issue has been automatically marked as stale because it has not had any activity in the past 30 days.

We use a stalebot among other tools to help manage the state of issues in this project. A stalebot can be very useful in closing issues in a number of cases; the most common is closing issues or PRs where the original reporter has not responded.

Stalebots are also emotionless and cruel and can close issues which are still very relevant.

If this issue is important to you, please add a comment to keep it open. More importantly, please add a thumbs-up to the original issue entry.

We regularly sort for closed issues which have a stale label sorted by thumbs up.

We may also:

We are doing our best to respond, organize, and prioritize all issues but it can be a challenging task, our sincere apologies if you find yourself at the mercy of the stalebot.