search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
https://localai.io
MIT License
26.17k stars 1.96k forks source link

Error: rpc error: code = Unknown desc = unimplemented #4170

Open emircanerkul opened 5 days ago

emircanerkul commented 5 days ago

Error: rpc error: code = Unknown desc = unimplemented

Using whisper-large-q5_0, localai/localai:v2.23.0-hipblas-ffmpeg image

Also for tarnished-9b-i1

Error: failed to load model with internal loader: could not load model: rpc error: code = Unknown desc = unsupported model type /build/models/tarnished-9b.i1-Q4_K_M.gguf (should end with .onnx)

emircanerkul commented 5 days ago

Also trying with linux binary but getting Error: failed to load model with internal loader: grpc service not ready