search

juicedata / juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.
https://juicefs.com
Apache License 2.0
10.82k stars 955 forks source link

write small files into metadata storage #4657

Closed aigc-anime closed 7 months ago

aigc-anime commented 7 months ago

What would you like to be added: Can files smaller than 4KB be written to metadata storage (tikv) instead of s3?

Why is this needed: This may improve IOPS for small files.

SandyXSD commented 7 months ago

This could potentially lead to exponential growth in the capacity demands of the metadata engine, which in many cases might prove to be counterproductive. We believe that it introduces additional complexity without delivering sufficient returns in most cases. Thus, for now we won't put it into our development roadmap.

Also we find that a similar feature in CephFS has been declared deprecated.