search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
https://localai.io
MIT License
23.24k stars 1.76k forks source link

Error running transcriptions on M2 MacBook Pro #2275

Open mynnx opened 4 months ago

mynnx commented 4 months ago

LocalAI version: 6559ac1

Environment, CPU architecture, OS, and Version: Darwin plompom 23.2.0 Darwin Kernel Version 23.2.0: Wed Nov 15 21:55:06 PST 2023; root:xnu-10002.61.3~2/RELEASE_ARM64_T6020 arm64 (2023 M2 MacBook Pro w/32GB RAM)

Describe the bug Trying to run transcriptions using cURL or local-ai transcript crashes the Go process for some reason. An error occurs.

To Reproduce Use any Whisper model and attempt to transcribe using LocalAI. I have succeeded in compiling whisper.cpp on this hardware and running transcriptions successfully on another project using the same input, so I know it's possible - but I'd love to do it over HTTP!

I have also succeeded in getting Llama3 models to respond to chat completion requests in LocalAI, so at least I know my LocalAI is setup and installed correctly.

Expected behavior transcriptions

Logs

❯ ./local-ai transcript --model=whisper-1 ~/Development/whisper-wise/best-year-yet/audios/1T7NOeyeWUZiVhRFzaEJOI_ds4yk93XEe.wav --log-level=debug
11:13PM INF loading environment variables from file envFile=.env
11:13PM DBG Setting logging to debug
11:13PM INF Loading model 'ggml-small.en.bin' with backend whisper
11:13PM DBG Loading model in memory from file: /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin
11:13PM DBG Loading Model ggml-small.en.bin with gRPC (file: /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin) (backend: whisper): {backendString:whisper model:ggml-small.en.bin threads:1 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0x140004b6000 externalBackends:map[] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false parallelRequests:false}
11:13PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/whisper
11:13PM DBG GRPC Service for ggml-small.en.bin will be running at: '127.0.0.1:59431'
11:13PM DBG GRPC Service state dir: /var/folders/_q/c4f71pn54gvbxgty8t96z8x00000gn/T/go-processmanager3803593630
11:13PM DBG GRPC Service Started
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 2024/05/07 23:13:32 gRPC Server listening at 127.0.0.1:59431
11:13PM DBG GRPC Service Ready
11:13PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:ggml-small.en.bin ContextSize:0 Seed:0 NBatch:0 F16Memory:false MLock:false MMap:false VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:0 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 ControlNet: Tokenizer: LoraBase: LoraAdapter: LoraScale:0 NoMulMatQ:false DraftModel: AudioPath: Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 MMProj: RopeScaling: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0 Type:}
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_init_from_file_with_params_no_state: loading model from '/Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: loading model
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_vocab       = 51864
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_ctx   = 1500
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_state = 768
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_head  = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_layer = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_ctx    = 448
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_state  = 768
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_head   = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_layer  = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_mels        = 80
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: ftype         = 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: qntvr         = 0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: type          = 3 (small)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: adding 1607 extra tokens
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_langs       = 99
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_backend_init: using Metal backend
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: allocating
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: found device: Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: picking default device: Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: loading '/tmp/localai/backend_data/backend-assets/grpc/default.metallib'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU name:   Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyApple8  (1008)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyMetal3  (5001)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: simdgroup reduction support   = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: simdgroup matrix mul. support = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: hasUnifiedMemory              = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: recommendedMaxWorkingSetSize  = 22906.50 MB
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr -[MTLComputePipelineDescriptorInternal setComputeFunction:withType:]:722: failed assertion `computeFunction must not be nil.'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr SIGABRT: abort
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr PC=0x18c37a0dc m=0 sigcode=0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr signal arrived during cgo execution
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 19 gp=0x14000185500 m=0 mp=0x10303c8e0 [syscall]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.cgocall(0x102a1bf98, 0x140000c17e8)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/cgocall.go:157 +0x44 fp=0x140000c17b0 sp=0x140000c1770 pc=0x102616bf4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go._Cfunc_whisper_init_from_file_with_params(0x150804080, {0x1, 0x0, 0x0, 0x0, 0xffffffff, {0x0, 0x0}, 0x8000000})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     _cgo_gotypes.go:517 +0x34 fp=0x140000c17e0 sp=0x140000c17b0 pc=0x102a0b9d4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go.Whisper_init({0x1400022c240?, 0x55?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/sources/whisper.cpp/bindings/go/whisper.go:105 +0x9c fp=0x140000c1890 sp=0x140000c17e0 pc=0x102a0d01c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go/pkg/whisper.New({0x1400022c240, 0x55})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/sources/whisper.cpp/bindings/go/pkg/whisper/model.go:30 +0x4c fp=0x140000c18c0 sp=0x140000c1890 pc=0x102a1494c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr main.(*Whisper).Load(0x1400000ed50, 0x6b?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/backend/go/transcribe/whisper.go:19 +0x2c fp=0x140000c18e0 sp=0x140000c18c0 pc=0x102a1ac9c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc.(*server).LoadModel(0x1400003b770, {0x102ca48c0?, 0x140000789d8?}, 0x14000261a00)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/server.go:50 +0xb8 fp=0x140000c1990 sp=0x140000c18e0 pc=0x102a088a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc/proto._Backend_LoadModel_Handler({0x102ca48c0, 0x1400003b770}, {0x102cd19e0, 0x1400022af00}, 0x14000258400, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/proto/backend_grpc.pb.go:352 +0x1c0 fp=0x140000c19e0 sp=0x140000c1990 pc=0x102a046c0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).processUnaryRPC(0x140001e61e0, {0x102cd19e0, 0x1400022ae40}, {0x102cd4fa0, 0x140000b0ea0}, 0x14000252120, 0x140001fa450, 0x102feedf0, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1343 +0xb40 fp=0x140000c1de0 sp=0x140000c19e0 pc=0x1029ed100
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).handleStream(0x140001e61e0, {0x102cd4fa0, 0x140000b0ea0}, 0x14000252120)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1737 +0x95c fp=0x140000c1f60 sp=0x140000c1de0 pc=0x1029f12dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).serveStreams.func1.1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:986 +0x88 fp=0x140000c1fd0 sp=0x140000c1f60 pc=0x1029eb288
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000c1fd0 sp=0x140000c1fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 13
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:997 +0x14c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 1 gp=0x140000021c0 m=nil [IO wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x8?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x140001dbac0 sp=0x140001dbaa0 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.netpollblock(0x140001dbb58?, 0x26eadd4?, 0x1?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:573 +0x158 fp=0x140001dbb00 sp=0x140001dbac0 pc=0x102646628
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.runtime_pollWait(0x1035c2770, 0x72)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:345 +0xa0 fp=0x140001dbb30 sp=0x140001dbb00 pc=0x10267ac20
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).wait(0x1400019ad80?, 0x8?, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x140001dbb60 sp=0x140001dbb30 pc=0x1026e6438
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).waitRead(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:89
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*FD).Accept(0x1400019ad80)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_unix.go:611 +0x250 fp=0x140001dbc10 sp=0x140001dbb60 pc=0x1026eaec0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*netFD).accept(0x1400019ad80)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/fd_unix.go:172 +0x28 fp=0x140001dbcd0 sp=0x140001dbc10 pc=0x102775d88
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPListener).accept(0x140000885c0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/tcpsock_posix.go:159 +0x28 fp=0x140001dbd00 sp=0x140001dbcd0 pc=0x10278bd58
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPListener).Accept(0x140000885c0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/tcpsock.go:327 +0x2c fp=0x140001dbd40 sp=0x140001dbd00 pc=0x10278afcc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).Serve(0x140001e61e0, {0x102cd0f90, 0x140000885c0})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:852 +0x44c fp=0x140001dbe80 sp=0x140001dbd40 pc=0x1029e9f0c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc.StartServer({0x16d7f165d?, 0x140000202b0?}, {0x102cd7550, 0x1400000ed50})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/server.go:226 +0x150 fp=0x140001dbf10 sp=0x140001dbe80 pc=0x102a0aa30
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr main.main()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/backend/go/transcribe/main.go:18 +0x94 fp=0x140001dbf40 sp=0x140001dbf10 pc=0x102a1a0d4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.main()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:271 +0x28c fp=0x140001dbfd0 sp=0x140001dbf40 pc=0x10264c7ec
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140001dbfd0 sp=0x140001dbfd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 2 gp=0x14000002c40 m=nil [force gc (idle)]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000066f90 sp=0x14000066f70 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.forcegchelper()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:326 +0xb8 fp=0x14000066fd0 sp=0x14000066f90 pc=0x10264caa8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000066fd0 sp=0x14000066fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.init.6 in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:314 +0x24
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 3 gp=0x14000003180 m=nil [GC sweep wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000067760 sp=0x14000067740 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.bgsweep(0x140000320e0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcsweep.go:278 +0xa0 fp=0x140000677b0 sp=0x14000067760 pc=0x1026389f0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gcenable.gowrap1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:203 +0x28 fp=0x140000677d0 sp=0x140000677b0 pc=0x10262cbf8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000677d0 sp=0x140000677d0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.gcenable in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:203 +0x6c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 4 gp=0x14000003340 m=nil [GC scavenge wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x140000320e0?, 0x102b93f60?, 0x1?, 0x0?, 0x14000003340?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000067f60 sp=0x14000067f40 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.(*scavengerState).park(0x10303b800)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcscavenge.go:425 +0x5c fp=0x14000067f90 sp=0x14000067f60 pc=0x1026363dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.bgscavenge(0x140000320e0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcscavenge.go:653 +0x44 fp=0x14000067fb0 sp=0x14000067f90 pc=0x102636934
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gcenable.gowrap2()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:204 +0x28 fp=0x14000067fd0 sp=0x14000067fb0 pc=0x10262cb98
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000067fd0 sp=0x14000067fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.gcenable in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:204 +0xac
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 5 gp=0x14000003c00 m=nil [finalizer wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0xb8?, 0x65?, 0x10267beb4?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000066580 sp=0x14000066560 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.runfinq()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mfinal.go:194 +0x108 fp=0x140000667d0 sp=0x14000066580 pc=0x10262bcc8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000667d0 sp=0x140000667d0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.createfing in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mfinal.go:164 +0x80
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 11 gp=0x14000185180 m=nil [select]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x1400030fef8?, 0x2?, 0x0?, 0x0?, 0x1400030fec4?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x1400030fd70 sp=0x1400030fd50 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.selectgo(0x1400030fef8, 0x1400030fec0, 0x1400030fed8?, 0x0, 0x1?, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/select.go:327 +0x614 fp=0x1400030fe80 sp=0x1400030fd70 pc=0x10265f564
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x1400009ca00, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:418 +0x14c fp=0x1400030ff20 sp=0x1400030fe80 pc=0x10296a6ec
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x140001e8d90)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:552 +0x7c fp=0x1400030ff80 sp=0x1400030ff20 pc=0x10296af5c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.NewServerTransport.func2()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:336 +0xd8 fp=0x1400030ffd0 sp=0x1400030ff80 pc=0x10297f3a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x1400030ffd0 sp=0x1400030ffd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:333 +0x1414
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 12 gp=0x14000185880 m=nil [select]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x14000316f28?, 0x4?, 0x88?, 0x6d?, 0x14000316ea8?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000316d40 sp=0x14000316d20 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.selectgo(0x14000316f28, 0x14000316ea0, 0x0?, 0x0, 0x0?, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/select.go:327 +0x614 fp=0x14000316e50 sp=0x14000316d40 pc=0x10265f564
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x140000b0ea0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:1152 +0x174 fp=0x14000316fb0 sp=0x14000316e50 pc=0x1029859a4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.NewServerTransport.gowrap1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x28 fp=0x14000316fd0 sp=0x14000316fb0 pc=0x10297f298
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000316fd0 sp=0x14000316fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x1454
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 13 gp=0x14000185a40 m=nil [IO wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0xffffffffffffffff?, 0xffffffffffffffff?, 0x23?, 0x0?, 0x1026cdf80?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x1400007ea40 sp=0x1400007ea20 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.netpollblock(0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:573 +0x158 fp=0x1400007ea80 sp=0x1400007ea40 pc=0x102646628
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.runtime_pollWait(0x1035c2678, 0x72)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:345 +0xa0 fp=0x1400007eab0 sp=0x1400007ea80 pc=0x10267ac20
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).wait(0x1400019af00?, 0x1400011a000?, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x1400007eae0 sp=0x1400007eab0 pc=0x1026e6438
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).waitRead(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:89
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*FD).Read(0x1400019af00, {0x1400011a000, 0x8000, 0x8000})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_unix.go:164 +0x200 fp=0x1400007eb80 sp=0x1400007eae0 pc=0x1026e7780
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*netFD).Read(0x1400019af00, {0x1400011a000?, 0x1400007ebf8?, 0x10266c12c?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/fd_posix.go:55 +0x28 fp=0x1400007ebd0 sp=0x1400007eb80 pc=0x1027741a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*conn).Read(0x1400006a3e0, {0x1400011a000?, 0x1400007ecc8?, 0x10262041c?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/net.go:179 +0x34 fp=0x1400007ec20 sp=0x1400007ebd0 pc=0x1027835a4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPConn).Read(0x1400007ec78?, {0x1400011a000?, 0xa532c4bd5316?, 0x1400021ea80?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     <autogenerated>:1 +0x2c fp=0x1400007ec50 sp=0x1400007ec20 pc=0x10279454c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr bufio.(*Reader).Read(0x14000045aa0, {0x14000186660, 0x9, 0x140001fa840?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/bufio/bufio.go:241 +0x1b4 fp=0x1400007ec90 sp=0x1400007ec50 pc=0x102734dd4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr io.ReadAtLeast({0x102cce580, 0x14000045aa0}, {0x14000186660, 0x9, 0x9}, 0x9)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/io/io.go:335 +0xa0 fp=0x1400007ece0 sp=0x1400007ec90 pc=0x1026c4180
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr io.ReadFull(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/io/io.go:354
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr golang.org/x/net/http2.readFrameHeader({0x14000186660, 0x9, 0x102681900?}, {0x102cce580?, 0x14000045aa0?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:237 +0x58 fp=0x1400007ed30 sp=0x1400007ece0 pc=0x1029575f8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr golang.org/x/net/http2.(*Framer).ReadFrame(0x14000186620)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:498 +0x78 fp=0x1400007ede0 sp=0x1400007ed30 pc=0x102957ce8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x140000b0ea0, 0x140001faa50)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:636 +0x110 fp=0x1400007eef0 sp=0x1400007ede0 pc=0x102981e30
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).serveStreams(0x140001e61e0, {0x102cd4fa0, 0x140000b0ea0})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:979 +0x188 fp=0x1400007ef70 sp=0x1400007eef0 pc=0x1029eb028
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).handleRawConn.func1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:920 +0x44 fp=0x1400007efd0 sp=0x1400007ef70 pc=0x1029ea914
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x1400007efd0 sp=0x1400007efd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:919 +0x150
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r0      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r1      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r2      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r3      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r4      0x73
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r5      0x2e
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r6      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r7      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r8      0x303fa79e02c0afdc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r9      0x303fa79fe079bfdc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r10     0xa
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r11     0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r12     0x37
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r13     0x14a45c110
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r14     0x1000001e2ba85d9
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r15     0x1e2ba85d8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r16     0x148
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r17     0x1ebc03340
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r18     0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r19     0x6
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r20     0x1e2b91000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r21     0x103
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r22     0x1e2b910e0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r23     0xffffffffffffffff
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r24     0x1e1a0a000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r25     0x1e1b71000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r26     0x1966bfbd9
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r27     0x16d7f0bf0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r28     0x102ba532c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r29     0x16d7f0730
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr lr      0x18c3b1cc0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr sp      0x16d7f0710
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr pc      0x18c37a0dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr fault   0x18c37a0dc
11:13PM ERR unable to stop all grpc processes error="process does not exist"
local-ai: error: could not load model: rpc error: code = Unavailable desc = error reading from server: EOF

Additional context

localai-bot commented 4 months ago

error reading from server: EOF