search

VikParuchuri / marker

Convert PDF to markdown quickly with high accuracy
https://www.datalab.to
GNU General Public License v3.0
16.77k stars 953 forks source link

High Ram usage #182

Open drmetro09 opened 3 months ago

drmetro09 commented 3 months ago

I have a rtx 3060 GPU , but when i run marker it uses gpu intermittently like it goes to 40% than back to 0% jumps and comes down but the ram usage is constantly 95% which causes windows os to freeze/ hang and the entire process gets disrupted with no results. My concern is that marker isn't continuously using Vram of GPU but instead using system ram . Is there any fix to this

Thanks

sophia20240527 commented 3 months ago

I have the same problem. Have you solved it?

yodatak commented 3 months ago

Same for me the systemd-oom kill the process it use like 14 GB of ram on linux and same GPU i try to decrase worker number but maybe its because my pdf is a book of heavy size ?

rmast commented 1 month ago

As rtx 3060 GPUs exist with 8 and 12 GB of VRAM this issue is not very clear om VRAM-usage. Also, the version of Pytorch might differ.