search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
https://localai.io
MIT License
22.85k stars 1.74k forks source link

Problem with piper #2372

Open 35develr opened 3 months ago

35develr commented 3 months ago

LocalAI version: quay.io/go-skynet/local-ai:master-cublas-cuda12-ffmpeg

Environment, CPU architecture, OS, and Version: INTEL7 - 12 cores, NVIDIA GTX 1060, 30GB RAM services: api: deploy: resources: reservations: devices:

Describe the bug piper crashes

Expected behavior Should create a WAV File

Logs :18PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/piper 4:18PM DBG GRPC Service for de-thorsten-low.onnx will be running at: '127.0.0.1:42717' 4:18PM DBG GRPC Service state dir: /tmp/go-processmanager444736499 4:18PM DBG GRPC Service Started 4:18PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 2024/05/22 16:18:59 gRPC Server listening at 127.0.0.1:42717 4:19PM DBG GRPC Service Ready 4:19PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:} sizeCache:0 unknownFields:[] Model:de-thorsten-low.onnx ContextSize:512 Seed:1516882724 NBatch:512 F16Memory:false MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:99999999 MainGPU: TensorSplit: Threads:4 LibrarySearchPath:/tmp/localai/backend_data/backend-assets/espeak-ng-data RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/de-thorsten-low.onnx Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 ControlNet: Tokenizer: LoraBase: LoraAdapter: LoraScale:0 NoMulMatQ:false DraftModel: AudioPath: Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 MMProj: RopeScaling: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0 Type: FlashAttention:false NoKVOffload:false} 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr terminate called after throwing an instance of 'nlohmann::json_abi_v3_11_2::detail::parse_error' 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr what(): [json.exception.parse_error.101] parse error at line 1, column 1: syntax error while parsing value - unexpected end of input; expected '[', '{', or a literal 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr SIGABRT: abort 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr PC=0x7f6bbf5fc9fc m=0 sigcode=18446744073709551610 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr signal arrived during cgo execution 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 10 gp=0xc00033a380 m=0 mp=0xe5a540 [syscall]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.cgocall(0x843e80, 0xc0000bb840) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/cgocall.go:157 +0x4b fp=0xc0000bb818 sp=0xc0000bb7e0 pc=0x41b54b 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr github.com/mudler/go-piper._Cfunc_piper_tts(0x142e570, 0x142a240, 0x1418930, 0x141a970, 0x142e6e0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr _cgo_gotypes.go:93 +0x4b fp=0xc0000bb840 sp=0xc0000bb818 pc=0x842eeb 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr github.com/mudler/go-piper.TextToWav({0xc0000da180?, 0x823b83?}, {0xc000026540, 0x14}, {0xc000158140, 0x37}, {0x0, 0x0}, {0xc000028540, 0x1c}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/sources/go-piper/piper.go:19 +0xe5 fp=0xc0000bb8a0 sp=0xc0000bb840 pc=0x843105 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr main.(PiperB).TTS(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/backend/go/tts/piper.go:48 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr main.(Piper).TTS(0x19c?, 0x19c?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/backend/go/tts/piper.go:31 +0x48 fp=0xc0000bb900 sp=0xc0000bb8a0 pc=0x8434a8 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr github.com/go-skynet/LocalAI/pkg/grpc.(server).TTS(0xc000033760, {0x9be200?, 0xc0000759e8?}, 0xc0001eca10) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/pkg/grpc/server.go:83 +0xea fp=0xc0000bb9a8 sp=0xc0000bb900 pc=0x83fc6a 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr github.com/go-skynet/LocalAI/pkg/grpc/proto._Backend_TTS_Handler({0x9be200, 0xc000033760}, {0xaa0780, 0xc0001ce840}, 0xc000196f00, 0x0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/pkg/grpc/proto/backend_grpc.pb.go:445 +0x1a9 fp=0xc0000bb9f8 sp=0xc0000bb9a8 pc=0x83c469 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).processUnaryRPC(0xc0001ea1e0, {0xaa0780, 0xc0001ce780}, {0xaa3da0, 0xc0000e6d00}, 0xc0000fd9e0, 0xc0001ce300, 0xe0d010, 0x0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1343 +0xdd1 fp=0xc0000bbdf0 sp=0xc0000bb9f8 pc=0x822451 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).handleStream(0xc0001ea1e0, {0xaa3da0, 0xc0000e6d00}, 0xc0000fd9e0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1737 +0xc47 fp=0xc0000bbf78 sp=0xc0000bbdf0 pc=0x827407 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).serveStreams.func1.1() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:986 +0x86 fp=0xc0000bbfe0 sp=0xc0000bbf78 pc=0x820326 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000bbfe8 sp=0xc0000bbfe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by google.golang.org/grpc.(Server).serveStreams.func1 in goroutine 9 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:997 +0x136 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 1 gp=0xc0000061c0 m=nil [IO wait]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0xc000040508?, 0x0?, 0xc0?, 0x61?, 0xc0001e5b60?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc0001e5b28 sp=0xc0001e5b08 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.netpollblock(0xc0001e5bc0?, 0x41ace6?, 0x0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/netpoll.go:573 +0xf7 fp=0xc0001e5b60 sp=0xc0001e5b28 pc=0x44a977 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.runtime_pollWait(0x7f6b7820bf20, 0x72) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/netpoll.go:345 +0x85 fp=0xc0001e5b80 sp=0xc0001e5b60 pc=0x47e6e5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(pollDesc).wait(0x3?, 0x1?, 0x0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0001e5ba8 sp=0xc0001e5b80 pc=0x4e8f07 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(pollDesc).waitRead(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_poll_runtime.go:89 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(FD).Accept(0xc000196e00) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_unix.go:611 +0x2ac fp=0xc0001e5c50 sp=0xc0001e5ba8 pc=0x4ee2ac 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(netFD).accept(0xc000196e00) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/net/fd_unix.go:172 +0x29 fp=0xc0001e5d08 sp=0xc0001e5c50 pc=0x5757c9 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(TCPListener).accept(0xc00007e5a0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/net/tcpsock_posix.go:159 +0x1e fp=0xc0001e5d30 sp=0xc0001e5d08 pc=0x58cb7e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(TCPListener).Accept(0xc00007e5a0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/net/tcpsock.go:327 +0x30 fp=0xc0001e5d60 sp=0xc0001e5d30 pc=0x58bd70 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).Serve(0xc0001ea1e0, {0xa9fd30, 0xc00007e5a0}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:852 +0x469 fp=0xc0001e5e98 sp=0xc0001e5d60 pc=0x81efa9 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr github.com/go-skynet/LocalAI/pkg/grpc.StartServer({0x7ffc29e7f9cc?, 0xc000024280?}, {0xaa6470, 0xc0000336b0}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/pkg/grpc/server.go:226 +0x170 fp=0xc0001e5f20 sp=0xc0001e5e98 pc=0x841af0 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr main.main() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /build/backend/go/tts/main.go:18 +0x85 fp=0xc0001e5f50 sp=0xc0001e5f20 pc=0x8432a5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.main() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:271 +0x29d fp=0xc0001e5fe0 sp=0xc0001e5f50 pc=0x45173d 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0001e5fe8 sp=0xc0001e5fe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 2 gp=0xc000006c40 m=nil [force gc (idle)]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc00005efa8 sp=0xc00005ef88 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goparkunlock(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:408 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.forcegchelper() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:326 +0xb3 fp=0xc00005efe0 sp=0xc00005efa8 pc=0x4519f3 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005efe8 sp=0xc00005efe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by runtime.init.6 in goroutine 1 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:314 +0x1a 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 3 gp=0xc000007180 m=nil [GC sweep wait]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc00005f780 sp=0xc00005f760 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goparkunlock(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:408 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.bgsweep(0xc000088000) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgcsweep.go:278 +0x94 fp=0xc00005f7c8 sp=0xc00005f780 pc=0x43d174 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gcenable.gowrap1() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgc.go:203 +0x25 fp=0xc00005f7e0 sp=0xc00005f7c8 pc=0x431ac5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005f7e8 sp=0xc00005f7e0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by runtime.gcenable in goroutine 1 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgc.go:203 +0x66 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 4 gp=0xc000007340 m=nil [GC scavenge wait]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0xc000088000?, 0xa982b8?, 0x1?, 0x0?, 0xc000007340?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc00005ff78 sp=0xc00005ff58 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goparkunlock(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:408 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.(scavengerState).park(0xe59d20) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00005ffa8 sp=0xc00005ff78 pc=0x43ab69 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.bgscavenge(0xc000088000) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgcscavenge.go:653 +0x3c fp=0xc00005ffc8 sp=0xc00005ffa8 pc=0x43b0fc 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gcenable.gowrap2() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgc.go:204 +0x25 fp=0xc00005ffe0 sp=0xc00005ffc8 pc=0x431a65 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by runtime.gcenable in goroutine 1 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mgc.go:204 +0xa5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 5 gp=0xc000007c00 m=nil [finalizer wait]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0xc00005e648?, 0x4251a5?, 0xa8?, 0x1?, 0xc0000061c0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc00005e620 sp=0xc00005e600 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.runfinq() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mfinal.go:194 +0x107 fp=0xc00005e7e0 sp=0xc00005e620 pc=0x430b07 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005e7e8 sp=0xc00005e7e0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by runtime.createfing in goroutine 1 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/mfinal.go:164 +0x3d 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 7 gp=0xc0001856c0 m=nil [select]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0xc000231f00?, 0x2?, 0x1e?, 0x0?, 0xc000231ed4?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc000231d80 sp=0xc000231d60 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.selectgo(0xc000231f00, 0xc000231ed0, 0x7b9c36?, 0x0, 0xc000380000?, 0x1) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/select.go:327 +0x725 fp=0xc000231ea0 sp=0xc000231d80 pc=0x462ee5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.(controlBuffer).get(0xc000094960, 0x1) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:418 +0x113 fp=0xc000231f30 sp=0xc000231ea0 pc=0x798b53 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.(loopyWriter).run(0xc000218150) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:552 +0x86 fp=0xc000231f90 sp=0xc000231f30 pc=0x7992a6 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.NewServerTransport.func2() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:336 +0xd5 fp=0xc000231fe0 sp=0xc000231f90 pc=0x7afb95 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000231fe8 sp=0xc000231fe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 24 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:333 +0x1a8c 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 8 gp=0xc000185880 m=nil [select]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0xc00005a740?, 0x4?, 0xf0?, 0xa5?, 0xc00005a6c0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc00005a558 sp=0xc00005a538 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.selectgo(0xc00005a740, 0xc00005a6b8, 0x0?, 0x0, 0x0?, 0x1) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/select.go:327 +0x725 fp=0xc00005a678 sp=0xc00005a558 pc=0x462ee5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.(http2Server).keepalive(0xc0000e6d00) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:1152 +0x205 fp=0xc00005a7c8 sp=0xc00005a678 pc=0x7b6ce5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.NewServerTransport.gowrap1() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x25 fp=0xc00005a7e0 sp=0xc00005a7c8 pc=0x7afa85 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005a7e8 sp=0xc00005a7e0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 24 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x1ace 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr goroutine 9 gp=0xc000185a40 m=nil [IO wait]: 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.gopark(0x9a0380?, 0xc0001ce750?, 0x6?, 0x0?, 0xb?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/proc.go:402 +0xce fp=0xc000074ab0 sp=0xc000074a90 pc=0x451b6e 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.netpollblock(0x4cefd8?, 0x41ace6?, 0x0?) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/netpoll.go:573 +0xf7 fp=0xc000074ae8 sp=0xc000074ab0 pc=0x44a977 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.runtime_pollWait(0x7f6b7820be28, 0x72) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/netpoll.go:345 +0x85 fp=0xc000074b08 sp=0xc000074ae8 pc=0x47e6e5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(pollDesc).wait(0xc0002d0500?, 0xc0002b4000?, 0x0) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000074b30 sp=0xc000074b08 pc=0x4e8f07 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(pollDesc).waitRead(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_poll_runtime.go:89 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr internal/poll.(FD).Read(0xc0002d0500, {0xc0002b4000, 0x8000, 0x8000}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc000074bc8 sp=0xc000074b30 pc=0x4ea1fa 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(netFD).Read(0xc0002d0500, {0xc0002b4000?, 0x1060100000000?, 0x8?}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/net/fd_posix.go:55 +0x25 fp=0xc000074c10 sp=0xc000074bc8 pc=0x5737e5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(conn).Read(0xc000110080, {0xc0002b4000?, 0x800010601?, 0xc000000000?}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/net/net.go:179 +0x45 fp=0xc000074c58 sp=0xc000074c10 pc=0x583d85 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr net.(TCPConn).Read(0x0?, {0xc0002b4000?, 0xc000074cb0?, 0x47154d?}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr :1 +0x25 fp=0xc000074c88 sp=0xc000074c58 pc=0x595ea5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr bufio.(Reader).Read(0xc0001d00c0, {0xc000186580, 0x9, 0xc000098808?}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/bufio/bufio.go:241 +0x197 fp=0xc000074cc0 sp=0xc000074c88 pc=0x5390f7 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr io.ReadAtLeast({0xa9d3e0, 0xc0001d00c0}, {0xc000186580, 0x9, 0x9}, 0x9) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/io/io.go:335 +0x90 fp=0xc000074d08 sp=0xc000074cc0 pc=0x4c8e10 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr io.ReadFull(...) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/io/io.go:354 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr golang.org/x/net/http2.readFrameHeader({0xc000186580, 0x9, 0xc000226030?}, {0xa9d3e0?, 0xc0001d00c0?}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:237 +0x65 fp=0xc000074d58 sp=0xc000074d08 pc=0x785cc5 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr golang.org/x/net/http2.(Framer).ReadFrame(0xc000186540) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:498 +0x85 fp=0xc000074e00 sp=0xc000074d58 pc=0x786405 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc/internal/transport.(http2Server).HandleStreams(0xc0000e6d00, 0xc0001ce600) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:636 +0x145 fp=0xc000074f08 sp=0xc000074e00 pc=0x7b2c25 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).serveStreams(0xc0001ea1e0, {0xaa3da0, 0xc0000e6d00}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:979 +0x1aa fp=0xc000074f80 sp=0xc000074f08 pc=0x8200ea 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr google.golang.org/grpc.(Server).handleRawConn.func1() 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:920 +0x45 fp=0xc000074fe0 sp=0xc000074f80 pc=0x81f945 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr runtime.goexit({}) 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.2.linux-amd64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x483821 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr created by google.golang.org/grpc.(Server).handleRawConn in goroutine 24 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr /root/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:919 +0x15b 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rax 0x0 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rbx 0x7f6bbf51bb00 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rcx 0x7f6bbf5fc9fc 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rdx 0x6 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rdi 0x818 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rsi 0x818 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rbp 0x818 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rsp 0x7ffc29e7d110 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r8 0x7ffc29e7d1e0 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r9 0x7ffc29e7cd20 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r10 0x8 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r11 0x246 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r12 0x6 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r13 0x16 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r14 0x7ffc29e7d7d0 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr r15 0x1 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rip 0x7f6bbf5fc9fc 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr rflags 0x246 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr cs 0x33 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr fs 0x0 4:19PM DBG GRPC(de-thorsten-low.onnx-127.0.0.1:42717): stderr gs 0x0 4:19PM ERR Server error error="rpc error: code = Unavailable desc = error reading from server: EOF" ip=10.9.0.1 latency=2.075764321s method=POST status=500 url=/tts

AdamLeyshon commented 1 month ago

I ran into something similar. It seems the current installed version only supports the models listed in the v0.0.2 release of piper. If you try to grab a recent model it throws this error. I tried en_GB-semaine-medium.onnx and I get the same issue, however, en-us-libritts-high.onnx from the release tagged in the doc works fine.