Closed vbanos closed 5 years ago
CdxServerDedupLoader used max_workers=400 by default. We make it a hidden CLI option --cdxserver-dedup-max-threads with a default value of 400.
CdxServerDedupLoader
max_workers=400
--cdxserver-dedup-max-threads
We need to be able to tweak this setting because it creates too many CDX queries which cause problems with our production CDX servers.
CdxServerDedupLoaderusedmax_workers=400by default. We make it a hidden CLI option--cdxserver-dedup-max-threadswith a default value of 400.We need to be able to tweak this setting because it creates too many CDX queries which cause problems with our production CDX servers.