search

openvinotoolkit / openvino.genai

Run Generative AI models using native OpenVINO C++ API
Apache License 2.0
107 stars 146 forks source link

fbgemm.dll missing while running benchmark.py #813

Open avinashbhat09 opened 1 week ago

avinashbhat09 commented 1 week ago

While running benchmark.py getting fbgemm.dll missing. This can be avoided if we copy this file libomp140.x86_64.dll into c:\windows\system32 gen-ai commit: 1674f8065b8875ff5612f114adb500ed0a15307f

image

eaidova commented 1 week ago

Hello @avinashbhat09 this is known issue of pytorch ((do you use torch 2.4, correct?), You can find suggested solutions for that on pytorch forum: https://discuss.pytorch.org/t/failed-to-import-pytorch-fbgemm-dll-or-one-of-its-dependencies-is-missing/201969

issue should be already fixed in torch 2.4.1, you can try to install the prerelease/nightly torch version to get this fix

pip3 uninstall torch torchvision torchaudio
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu

or downgrade torch to lower versions where there is not such issue:

pip3 uninstall torch torchvision torchaudio
pip3 install torch==2.3.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu
avinashbhat09 commented 1 week ago

Hi @eaidova : Can this be taken care in the requirements.txt? hardcode the torch version to be 2.4.1 or higher?

eaidova commented 1 week ago

@avinashbhat09 when 2.4.1 will be officially released then we do that, but for now, we can only provide this info in known issues.