huggingface / optimum-nvidia

Apache License 2.0
844 stars 83 forks source link

RuntimeError: Failed to import transformers.modeling_utils #103

Closed Quang-elec44 closed 3 months ago

Quang-elec44 commented 4 months ago

Hi, I just pulled the latest docker image using this command docker pull huggingface/optimum-nvidia:0.1.0b4 and when I ran python text-generation.py -h, there was an error. Here is the full log:

RuntimeError: Failed to import transformers.modeling_utils because of the following error (look up to see its traceback):
Failed to import transformers.generation.utils because of the following error (look up to see its traceback):
/usr/local/lib/python3.10/dist-packages/transformer_engine_extensions.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

BTW: I tried to install via pip but it seems that you guys haven't pushed the package optimum-nvidia on the website