search

s3gw-tech / s3gw

Container able to run on a Kubernetes cluster, providing S3-compatible endpoints to applications.
https://s3gw.tech
Apache License 2.0
149 stars 21 forks source link

rgw/sfs: implement metadata key iterator class #110

Open tserong opened 2 years ago

tserong commented 2 years ago

Following on from https://github.com/aquarist-labs/ceph/pull/39, we should implement a class that knows how to iterate through metadata keys (users, buckets, ... what else?) so that the max and truncated arguments to SFStore::meta_list_keys_next() will actually work. Note in particular that when listing buckets via the admin REST API, that code tries to iterate through buckets 1000 at a time. Our current implementation of SFStore::meta_list_keys_next() will just return everything, because it can't handle max and truncated.

jecluis commented 1 year ago

oof - this is something that still needs to be addressed, but requires further investigation into what the requirements are.

jecluis commented 1 year ago

We'll address this for GA, pushing forward in time for review then.