This PR allows the aavs_uv converter to process multiple files in parallel.
Version: Bumped from 1.6.0 to 1.7.0.
Parallel processing: For faster processing of multiple files, the converter now use parallel processing capabilities provided by the 'dask' library.
Progress bar: The previous tqdm progress bar was replaced with daskProgressBar. A new function called convert_single_file() was also defined for use with dask.delayed.
Logging improvements:converter.py contains a new function reset_logger() to setup the loguru logger. A verbose flag -v has been added
Profiling: The dask ResourceProfiler and Profiler can now be enabled using the -P flag.
Tests: The test module tests/test_converter.py has an additional test case named test_dask()for the newly introduced parallel conversion functionality.
This PR allows the
aavs_uv
converter to process multiple files in parallel.Version: Bumped from 1.6.0 to 1.7.0.
Parallel processing: For faster processing of multiple files, the converter now use parallel processing capabilities provided by the 'dask' library.
Progress bar: The previous tqdm progress bar was replaced with dask
ProgressBar
. A new function calledconvert_single_file()
was also defined for use withdask.delayed
.Logging improvements:
converter.py
contains a new functionreset_logger()
to setup the loguru logger. A verbose flag-v
has been addedProfiling: The dask
ResourceProfiler
andProfiler
can now be enabled using the-P
flag.Tests: The test module
tests/test_converter.py
has an additional test case namedtest_dask()
for the newly introduced parallel conversion functionality.