GPU support - Githubissues

cpllab / lm-zoo

Easy black-box access to state-of-the-art language models

https://cpllab.github.io/lm-zoo/

MIT License

14 stars 6 forks source link

GPU support #46

Open hans opened 4 years ago

hans commented 4 years ago

Use some new environment variable e.g. LMZOO_GPU_ENABLED.

[x] Verify that CUDA_VISIBLE_DEVICES gets passed through on all backends
[x] update images to read and act on env variable
[ ] add CLI switch

AnneBeyer commented 3 years ago

Could you please add some more instructions on how to enable GPU usage for the other models not mentioned in #49? We're trying to use some larger pre-trained models with syntaxgym and can't get them to use the available GPUs.