Cu118 or cu124 for Pascal TeslaP40 ?

sasha0552 / vllm-ci

CI scripts designed to build a Pascal-compatible version of vLLM.

MIT License

8 stars 1 forks source link

Closed neowisard closed 1 month ago

neowisard commented 1 month ago

A bit confused - do I have to reinstall torch with cu118 after the initial installation ? if I have P40 (11.8 cuda).

sasha0552 commented 1 month ago

As far as I know, torch downloads separate cuda libraries (nvidia-*, like nvidia-cublas), so no, everything should work as is.