Is it possible to set using CUDA:1 or something else?

VikParuchuri / marker

Convert PDF to markdown quickly with high accuracy

https://www.datalab.to

GNU General Public License v3.0

16.8k stars 954 forks source link

Is it possible to set using CUDA:1 or something else? #140

Closed Watterry closed 4 months ago

Watterry commented 4 months ago

I tried to use CUDA:1 or other device because my CUDA:0 is taken by other application. I tried to change "cuda" to "cuda:1" in all script but it didn't worked.

Is it possible to do this?

VikParuchuri commented 4 months ago

Just set CUDA_VISIBLE_DEVICES=1 as an env var, and set TORCH_DEVICE=cuda