Closed vbanos closed 6 years ago
WarcWriterPool._lock seems redundant. WarcWriter already has locking.
WarcWriterPool._lock
WarcWriter
I removed it and run various tests without an issue.
There is also a performance increase (around ~0.5-1 sec) when running benchmarks/run_benchmark.py
benchmarks/run_benchmark.py
This lock is necessary and it shouldn't be removed.
WarcWriterPool._lock
seems redundant.WarcWriter
already has locking.I removed it and run various tests without an issue.
There is also a performance increase (around ~0.5-1 sec) when running
benchmarks/run_benchmark.py