Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
3.71k
stars
338
forks
source link
ValueError: Invalid output format webdataset\--output_folder #349
Closed
YMKiii closed 1 year ago
(base) PS E:\AI> img2dataset --url_list mscoco.parquet --input_format "parquet"\ --url_col"URL" --caption_col "TEXT" --output_format webdataset--output_folder mscoco --processes_count 16 --thread_count 64 --image_size 256--enable_wandb True Traceback (most recent call last): File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "E:\Anaconda\Scripts\img2dataset.exe__main__.py", line 7, in
File "E:\Anaconda\Lib\site-packages\img2dataset\main.py", line 270, in main
fire.Fire(download)
File "E:\Anaconda\Lib\site-packages\fire\core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Anaconda\Lib\site-packages\fire\core.py", line 466, in _Fire
component, remaining_args = _CallAndUpdateTrace(
^^^^^^^^^^^^^^^^^^^^
File "E:\Anaconda\Lib\site-packages\fire\core.py", line 681, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^
File "E:\Anaconda\Lib\site-packages\img2dataset\main.py", line 203, in download
raise ValueError(f"Invalid output format {output_format}")
ValueError: Invalid output format webdataset--output_folder