VikParuchuri / marker

Convert PDF to markdown quickly with high accuracy
https://www.datalab.to
GNU General Public License v3.0
13.97k stars 707 forks source link

I get this error : Number of processes must be at least 1 for multi gplu convertion #185

Open issa2k23 opened 3 weeks ago

issa2k23 commented 3 weeks ago

I am using windows 10 and this is the command : marker in-pdf out-pdf --num_chunks 2 --chunk_idx 2 --workers 15

Converting 0 pdfs in chunk 3/2 with 0 processes, and storing in F:\PDF-Marker\out-pdf Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "D:\AI\anaconda3\envs\Marker\Scripts\marker.exe__main__.py", line 7, in File "D:\AI\anaconda3\envs\Marker\Lib\site-packages\convert.py", line 123, in main with mp.Pool(processes=total_processes, initializer=worker_init, initargs=(model_lst,)) as pool: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\anaconda3\envs\Marker\Lib\multiprocessing\context.py", line 119, in Pool return Pool(processes, initializer, initargs, maxtasksperchild, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\anaconda3\envs\Marker\Lib\multiprocessing\pool.py", line 205, in init raise ValueError("Number of processes must be at least 1") ValueError: Number of processes must be at least 1

joeamroo commented 3 weeks ago

Are the files in a subdirectory inside of "in-pdf"? It needs to be in that main directory you specify.

issa2k23 commented 3 weeks ago

yes they are, when I run the single file conversion just works. but I have this problem when I want to run for multi files (in a directory) and multi-gpu