search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.56k stars 582 forks source link

cloud_storage: Merge redpanda.remote.read/write into one property #5313

Open Lazin opened 2 years ago

Lazin commented 2 years ago

Who is this for and what problem do they have today?

Currently we have two configs redpanda.remote.read and redpanda.remote.write. The first one enables segment downloads and the whole SI feature. The second one enables data uploading. We need to make both configs enabled if any of them is enabled. We also need to introduce new topic config that enables everything with one flag.

What are the success criteria?

SI can be enabled with a single flag.

Why is solving this problem impactful?

This enables shallow topic recovery (the recovery process that doesn't download the data to the local disk).

JIRA Link: CORE-962

emaxerrno commented 2 years ago

the combined property name should be redpanda.tiered=true cc: @dhruv-gupta and @rkruze @piyushredpanda