search

sail-sg / oat

🌾 OAT: Online AlignmenT for LLMs
https://arxiv.org/pdf/2411.01493
Apache License 2.0
33 stars 2 forks source link

Could not load dynamic library 'libcudart.so.11.0' #14

Open MYC000801 opened 1 week ago

MYC000801 commented 1 week ago

When I try the example script, it reports errors:

image

My cuda version 12.7. I would like to ask if the cuda version is required to be 11.x. Thanks a lot in advance!

Environment information: Python: 3.10.9 CUDA: 12.7 I just create the environment following the instruction git clone git@github.com:sail-sg/oat.git cd oat pip install vllm==0.6.2 && pip install -e .

lkevinzc commented 1 week ago

Hi @MYC000801, I think cuda12 should be fine. Here are my packages when I run pip list | grep cuda:

image

I think your issue may be resolved by setting the LD_LIBRARY_PATH to point to your python package's lib. For me, I put this line in my ~/.zshrc (or ~/.bashrc if you do not use zsh):

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/aiops/liuzc/miniforge3/envs/oat/lib/

Ref: https://stackoverflow.com/a/21173918. Hope this helps!