search

juicedata / juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.
https://juicefs.com
Apache License 2.0
10.58k stars 925 forks source link

Add an option to limit the concurrent compact #1731

Open cs-lpc opened 2 years ago

cs-lpc commented 2 years ago

What would you like to be added:

add an option to limit the concurrent compact

Why is this needed: In some use case, we need more threads to compact data. Especially when the data in local cache. But we can not change the number of threads by configuration

cs-lpc commented 2 years ago

We have faced this problem, and modified the number of compact concurrent. And found no problems in the test