search

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

OSError: .......cannot open shared object file: No such file or directory #209

Open Saurabh11811 opened 2 months ago

Saurabh11811 commented 2 months ago

I am using the base code as given in HF

from ctransformers import AutoModelForCausalLM llm = AutoModelForCausalLM.from_pretrained('marella/gpt-2-ggml') print(llm('AI is going to'))

While this works fine locally on Mac machine, it fails on any of the linux environment (I tried Debian, Ubuntu, Alpine etc. ) using docker.

Here are the errors for each of them

For Apline (FROM python:3.12.1-alpine3.19)

Error is - OSError: Error relocating /usr/local/lib/python3.12/site-packages/ctransformers/lib/basic/libctransformers.so: unsupported relocation type 7

For both Debian, Ubuntu Error is - OSError: /usr/local/lib/python3.11/site-packages/ctransformers/lib/basic/libctransformers.so: cannot open shared object file: No such file or directory

Even for direct python3.11 images same error comes.

I am trying the latest version

jash-gmu commented 2 months ago

i am facing the same issue, did you find any solution ?

Saurabh11811 commented 2 months ago

Yes. The issue is because of CPU architecture type for the pulled image. I was using mac and docker by default pull linux image of arm type which is incompatible with ctransformers unless you compile from source (no clear steps). Workaround is you pull the x86/amd image in docker by defining platform parameter in docker file and it will work. BrSaurabhSent from my iPhoneOn 23 Apr 2024, at 8:12 PM, Jashwanth Raj Gowlikar @.***> wrote: i am facing the same issue, did you find any solution ?

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>