Confused about cuda version, cuda 10.2 or cuda 11.6 are supported or not by lightseq inference

bytedance / lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

Other

3.22k stars 329 forks source link

Confused about cuda version, cuda 10.2 or cuda 11.6 are supported or not by lightseq inference #308

Open lilyzlt opened 2 years ago

lilyzlt commented 2 years ago

when I run inference coda, cuda version cannot > cuda 11, it only works at cuda 10.2 (one issue also about this problem) eg: run code in lightseq/examples/inference/python/test/

when I build from source, follow the https://github.com/bytedance/lightseq/blob/master/docs/inference/build.md the requirement :cudatoolkit-dev >= 10.1 < 11 but at the CMakeList.txt :find_package(CUDA 11.6 REQUIRED）which means it need CUDA 11.6,

so I am confused now about CUDA version, any update about this?

lilyzlt commented 2 years ago

just confirmed, V2.2.0 version CMakeList.txt require cuda version is 10.1 latest version require cuda version is 11.6 that means base on your version of cuda, build different .so file, right? if I wanna build from source using cmake, but cuda =10.2, how to build it ?

LiYijin commented 2 years ago

But fairseq only support 10.2， how to deal with this?