myhloli
commented
4 months ago 请仔细阅读readme中关于cuda加速的相关说明，device-mode不能是“gpu”，如果需要cuda加速，device-mode的值应设置为“cuda”。
https://github.com/opendatalab/MinerU/blob/master/docs/README_Ubuntu_CUDA_Acceleration_zh_CN.md
Leosgp
Description of the bug | 错误描述
错误：model/PDF-Extract-Kit/models CustomVisionEncoderDecoderModel init CustomMBartForCausalLM init CustomMBartDecoder init 2024-08-05 14:51:57.803 | ERROR | magic_pdf.cli.magicpdf:parse_doc:338 - Expected one of cpu, cuda, ipu, xpu, mkldnn, opengl, opencl, ideep, hip, ve, fpga, ort, xla, lazy, vulkan, mps, meta, hpu, mtia, privateuseone device type at start of device string: gpu Traceback (most recent call last):
File "/home/algo/.conda/envs/MinerU/bin/magic-pdf", line 8, in
sys.exit(cli())
│ │ └
│ └
└ <module 'sys' (built-in)>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1157, in call
return self.main(args, kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <function BaseCommand.main at 0x7ff131a64430>
└
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
│ │ └ <click.core.Context object at 0x7ff131c65a80>
│ └ <function MultiCommand.invoke at 0x7ff131a653f0>
└
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
│ │ │ │ └ <click.core.Context object at 0x7fefe30e28f0>
│ │ │ └ <function Command.invoke at 0x7ff131a64ee0>
│ │ └
│ └ <click.core.Context object at 0x7fefe30e28f0>
└ <function MultiCommand.invoke.._process_result at 0x7ff13919fd90>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, ctx.params)
│ │ │ │ │ └ {'pdf': '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf', 'model': None, 'method': 'auto', 'inside_model': True, '...
│ │ │ │ └ <click.core.Context object at 0x7fefe30e28f0>
│ │ │ └ <function pdf_command at 0x7fefe2af5a20>
│ │ └
│ └ <function Context.invoke at 0x7ff131a47be0>
└ <click.core.Context object at 0x7fefe30e28f0>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 783, in invoke
return __callback( args, **kwargs)
│ └ {'pdf': '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf', 'model': None, 'method': 'auto', 'inside_model': True, '...
└ ()
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/magic_pdf/cli/magicpdf.py", line 352, in pdf_command
parse_doc(pdf)
│ └ '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf'
└ <function pdf_command..parse_doc at 0x7fefe2af5750>
RuntimeError: Expected one of cpu, cuda, ipu, xpu, mkldnn, opengl, opencl, ideep, hip, ve, fpga, ort, xla, lazy, vulkan, mps, meta, hpu, mtia, privateuseone device type at start of device string: gpu
CPU正常识别，但是速度很慢，服务器有8张A100,但是改config文件CPU为GPU报这个错误
How to reproduce the bug | 如何复现
错误：model/PDF-Extract-Kit/models CustomVisionEncoderDecoderModel init CustomMBartForCausalLM init CustomMBartDecoder init 2024-08-05 14:51:57.803 | ERROR | magic_pdf.cli.magicpdf:parse_doc:338 - Expected one of cpu, cuda, ipu, xpu, mkldnn, opengl, opencl, ideep, hip, ve, fpga, ort, xla, lazy, vulkan, mps, meta, hpu, mtia, privateuseone device type at start of device string: gpu Traceback (most recent call last):
File "/home/algo/.conda/envs/MinerU/bin/magic-pdf", line 8, in
sys.exit(cli())
│ │ └
│ └
└ <module 'sys' (built-in)>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1157, in call
return self.main(args, kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <function BaseCommand.main at 0x7ff131a64430>
└
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
│ │ └ <click.core.Context object at 0x7ff131c65a80>
│ └ <function MultiCommand.invoke at 0x7ff131a653f0>
└
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
│ │ │ │ └ <click.core.Context object at 0x7fefe30e28f0>
│ │ │ └ <function Command.invoke at 0x7ff131a64ee0>
│ │ └
│ └ <click.core.Context object at 0x7fefe30e28f0>
└ <function MultiCommand.invoke.._process_result at 0x7ff13919fd90>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, ctx.params)
│ │ │ │ │ └ {'pdf': '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf', 'model': None, 'method': 'auto', 'inside_model': True, '...
│ │ │ │ └ <click.core.Context object at 0x7fefe30e28f0>
│ │ │ └ <function pdf_command at 0x7fefe2af5a20>
│ │ └
│ └ <function Context.invoke at 0x7ff131a47be0>
└ <click.core.Context object at 0x7fefe30e28f0>
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/click/core.py", line 783, in invoke
return __callback( args, **kwargs)
│ └ {'pdf': '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf', 'model': None, 'method': 'auto', 'inside_model': True, '...
└ ()
File "/home/algo/.conda/envs/MinerU/lib/python3.10/site-packages/magic_pdf/cli/magicpdf.py", line 352, in pdf_command
parse_doc(pdf)
│ └ '/home/algo/zhengkaiyuan/PaperEx/data/明日DMP操作手册-V3-2-2.pdf'
└ <function pdf_command..parse_doc at 0x7fefe2af5750>
RuntimeError: Expected one of cpu, cuda, ipu, xpu, mkldnn, opengl, opencl, ideep, hip, ve, fpga, ort, xla, lazy, vulkan, mps, meta, hpu, mtia, privateuseone device type at start of device string: gpu
Operating system | 操作系统
Linux
Python version | Python 版本
3.10
Software version | 软件版本 (magic-pdf --version)
0.6.x
Device mode | 设备模式
cuda