search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
https://localai.io
MIT License
25.16k stars 1.91k forks source link

Error while attempting to use LocalAI via the api #660

Closed dillfrescott closed 1 year ago

dillfrescott commented 1 year ago 
2023-06-23 03:52:04 7:52AM DBG [llama] Loads OK
2023-06-23 03:52:40 fatal error: unexpected signal during runtime execution
2023-06-23 03:52:40 [signal SIGSEGV: segmentation violation code=0x80 addr=0x0 pc=0xa836b0]
2023-06-23 03:52:40 
2023-06-23 03:52:40 runtime stack:
2023-06-23 03:52:40 runtime.throw({0x1399be4?, 0x7f2fdf1c258f?})
2023-06-23 03:52:40     /usr/local/go/src/runtime/panic.go:1047 +0x5d fp=0x7f3170cd42b8 sp=0x7f3170cd4288 pc=0x4ac3bd
2023-06-23 03:52:40 runtime.sigpanic()
2023-06-23 03:52:40     /usr/local/go/src/runtime/signal_unix.go:825 +0x3e9 fp=0x7f3170cd4318 sp=0x7f3170cd42b8 pc=0x4c2869
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 33 [syscall]:
2023-06-23 03:52:40 runtime.cgocall(0x9ba9a0, 0xc00020c158)
2023-06-23 03:52:40     /usr/local/go/src/runtime/cgocall.go:157 +0x5c fp=0xc00020c130 sp=0xc00020c0f8 pc=0x47b25c
2023-06-23 03:52:40 github.com/go-skynet/go-llama%2ecpp._Cfunc_llama_predict(0x7f31601f73d0, 0x7f3160000bc0, 0xc000386000, 0x1)
2023-06-23 03:52:40     _cgo_gotypes.go:216 +0x4c fp=0xc00020c158 sp=0xc00020c130 pc=0x9045cc
2023-06-23 03:52:40 github.com/go-skynet/go-llama%2ecpp.(*LLama).Predict.func2(0xc000323b00?, 0xc00020c348?, {0xc000386000, 0x0?, 0x130ff00?}, 0xc0000c0b01?)
2023-06-23 03:52:40     /build/go-llama/llama.go:211 +0x94 fp=0xc00020c1a8 sp=0xc00020c158 pc=0x907194
2023-06-23 03:52:40 github.com/go-skynet/go-llama%2ecpp.(*LLama).Predict(0xc000012858, {0xc000323b00, 0xd37}, {0xc0000c0be0, 0xe, 0x0?})
2023-06-23 03:52:40     /build/go-llama/llama.go:211 +0x2c8 fp=0xc00020c460 sp=0xc00020c1a8 pc=0x906e28
2023-06-23 03:52:40 github.com/go-skynet/LocalAI/api.ModelInference.func12()
2023-06-23 03:52:40     /build/api/prediction.go:539 +0xde fp=0xc00020c788 sp=0xc00020c460 pc=0x98841e
2023-06-23 03:52:40 github.com/go-skynet/LocalAI/api.ModelInference.func14()
2023-06-23 03:52:40     /build/api/prediction.go:581 +0x1aa fp=0xc00020c840 sp=0xc00020c788 pc=0x987f6a
2023-06-23 03:52:40 github.com/go-skynet/LocalAI/api.ComputeChoices({0xc000323b00, 0xd37}, 0xc0000ea140, 0xc0000d2b00, 0xc00025c600?, 0x1?, 0x194b228, 0x200?)
2023-06-23 03:52:40     /build/api/prediction.go:605 +0x246 fp=0xc00020d100 sp=0xc00020c840 pc=0x98b2c6
2023-06-23 03:52:40 github.com/go-skynet/LocalAI/api.chatEndpoint.func2(0xc0000d2580)
2023-06-23 03:52:40     /build/api/openai.go:444 +0x8c5 fp=0xc00020d2b0 sp=0xc00020d100 pc=0x981225
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*App).next(0xc0000d9200, 0xc0000d2580)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x1bf fp=0xc00020d358 sp=0xc00020d2b0 pc=0x8ca79f
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*Ctx).Next(0x0?)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:913 +0x53 fp=0xc00020d378 sp=0xc00020d358 pc=0x8b51f3
2023-06-23 03:52:40 github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x2?)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/recover/recover.go:43 +0xcb fp=0xc00020d3f0 sp=0xc00020d378 pc=0x8d760b
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*Ctx).Next(0xc000204a80?)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:910 +0x43 fp=0xc00020d410 sp=0xc00020d3f0 pc=0x8b51e3
2023-06-23 03:52:40 github.com/gofiber/fiber/v2/middleware/logger.New.func3(0xc0000d2580)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/logger/logger.go:122 +0x395 fp=0xc00020db30 sp=0xc00020d410 pc=0x8d1df5
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*App).next(0xc0000d9200, 0xc0000d2580)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x1bf fp=0xc00020dbd8 sp=0xc00020db30 pc=0x8ca79f
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*App).handler(0xc0000d9200, 0x502657?)
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:171 +0x87 fp=0xc00020dc38 sp=0xc00020dbd8 pc=0x8ca9e7
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*App).handler-fm(0xc0004e8000?)
2023-06-23 03:52:40     <autogenerated>:1 +0x2c fp=0xc00020dc58 sp=0xc00020dc38 pc=0x8cfc0c
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*Server).serveConn(0xc000270000, {0x19dec20?, 0xc0004a8008})
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:2363 +0x11d3 fp=0xc00020dec8 sp=0xc00020dc58 pc=0x82ce53
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*Server).serveConn-fm({0x19dec20?, 0xc0004a8008?})
2023-06-23 03:52:40     <autogenerated>:1 +0x39 fp=0xc00020def0 sp=0xc00020dec8 pc=0x83c719
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000c0aa0, 0xc0004d6000)
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:224 +0xa9 fp=0xc00020dfa0 sp=0xc00020def0 pc=0x838949
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*workerPool).getCh.func1()
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:196 +0x38 fp=0xc00020dfe0 sp=0xc00020dfa0 pc=0x8386b8
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00020dfe8 sp=0xc00020dfe0 pc=0x4de2e1
2023-06-23 03:52:40 created by github.com/valyala/fasthttp.(*workerPool).getCh
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:195 +0x1b0
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 1 [IO wait]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00022f288 sp=0xc00022f268 pc=0x4af116
2023-06-23 03:52:40 runtime.netpollblock(0xc00022f2d0?, 0x47a8ef?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc00022f2c0 sp=0xc00022f288 pc=0x4a79b7
2023-06-23 03:52:40 internal/poll.runtime_pollWait(0x7f3170d54c98, 0x72)
2023-06-23 03:52:40     /usr/local/go/src/runtime/netpoll.go:306 +0x89 fp=0xc00022f2e0 sp=0xc00022f2c0 pc=0x4d8b89
2023-06-23 03:52:40 internal/poll.(*pollDesc).wait(0xc000030400?, 0x49e400?, 0x0)
2023-06-23 03:52:40     /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00022f308 sp=0xc00022f2e0 pc=0x54f592
2023-06-23 03:52:40 internal/poll.(*pollDesc).waitRead(...)
2023-06-23 03:52:40     /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
2023-06-23 03:52:40 internal/poll.(*FD).Accept(0xc000030400)
2023-06-23 03:52:40     /usr/local/go/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc00022f3b0 sp=0xc00022f308 pc=0x554e9d
2023-06-23 03:52:40 net.(*netFD).accept(0xc000030400)
2023-06-23 03:52:40     /usr/local/go/src/net/fd_unix.go:172 +0x35 fp=0xc00022f468 sp=0xc00022f3b0 pc=0x5dc035
2023-06-23 03:52:40 net.(*TCPListener).accept(0xc0000125d0)
2023-06-23 03:52:40     /usr/local/go/src/net/tcpsock_posix.go:148 +0x25 fp=0xc00022f490 sp=0xc00022f468 pc=0x5f23e5
2023-06-23 03:52:40 net.(*TCPListener).Accept(0xc0000125d0)
2023-06-23 03:52:40     /usr/local/go/src/net/tcpsock.go:297 +0x3d fp=0xc00022f4c0 sp=0xc00022f490 pc=0x5f14dd
2023-06-23 03:52:40 github.com/valyala/fasthttp.acceptConn(0xc000270000, {0x19dc180, 0xc0000125d0}, 0xc00022f6b8)
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1928 +0x62 fp=0xc00022f5a0 sp=0xc00022f4c0 pc=0x82b322
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*Server).Serve(0xc000270000, {0x19dc180?, 0xc0000125d0})
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1821 +0x4f4 fp=0xc00022f6e8 sp=0xc00022f5a0 pc=0x82a934
2023-06-23 03:52:40 github.com/gofiber/fiber/v2.(*App).Listen(0xc0000d9200, {0xc000028050?, 0x7?})
2023-06-23 03:52:40     /go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/listen.go:88 +0x11d fp=0xc00022f748 sp=0xc00022f6e8 pc=0x8c17fd
2023-06-23 03:52:40 main.main.func1(0xc00022fba0?)
2023-06-23 03:52:40     /build/main.go:140 +0x6c6 fp=0xc00022f990 sp=0xc00022f748 pc=0x9ba286
2023-06-23 03:52:40 github.com/urfave/cli/v2.(*Command).Run(0xc000262160, 0xc00007a940, {0xc000024040, 0x2, 0x2})
2023-06-23 03:52:40     /go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/command.go:274 +0x9eb fp=0xc00022fc30 sp=0xc00022f990 pc=0x9a776b
2023-06-23 03:52:40 github.com/urfave/cli/v2.(*App).RunContext(0xc00025e000, {0x19dc4e8?, 0xc00002a0a8}, {0xc000024040, 0x2, 0x2})
2023-06-23 03:52:40     /go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:332 +0x616 fp=0xc00022fca0 sp=0xc00022fc30 pc=0x9a4096
2023-06-23 03:52:40 github.com/urfave/cli/v2.(*App).Run(...)
2023-06-23 03:52:40     /go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:309
2023-06-23 03:52:40 main.main()
2023-06-23 03:52:40     /build/main.go:144 +0xff6 fp=0xc00022ff80 sp=0xc00022fca0 pc=0x9b9af6
2023-06-23 03:52:40 runtime.main()
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:250 +0x207 fp=0xc00022ffe0 sp=0xc00022ff80 pc=0x4aece7
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00022ffe8 sp=0xc00022ffe0 pc=0x4de2e1
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 2 [force gc (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062fb0 sp=0xc000062f90 pc=0x4af116
2023-06-23 03:52:40 runtime.goparkunlock(...)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:387
2023-06-23 03:52:40 runtime.forcegchelper()
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc000062fe0 sp=0xc000062fb0 pc=0x4aef50
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.init.6
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:293 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 3 [GC sweep wait]:
2023-06-23 03:52:40 runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000063780 sp=0xc000063760 pc=0x4af116
2023-06-23 03:52:40 runtime.goparkunlock(...)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:387
2023-06-23 03:52:40 runtime.bgsweep(0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgcsweep.go:319 +0xde fp=0xc0000637c8 sp=0xc000063780 pc=0x49b2be
2023-06-23 03:52:40 runtime.gcenable.func1()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000637e0 sp=0xc0000637c8 pc=0x490526
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcenable
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:178 +0x6b
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 4 [GC scavenge wait]:
2023-06-23 03:52:40 runtime.gopark(0x4abb922a929?, 0x11c939db?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000063f70 sp=0xc000063f50 pc=0x4af116
2023-06-23 03:52:40 runtime.goparkunlock(...)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:387
2023-06-23 03:52:40 runtime.(*scavengerState).park(0x1ed94e0)
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000063fa0 sp=0xc000063f70 pc=0x499193
2023-06-23 03:52:40 runtime.bgscavenge(0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc000063fc8 sp=0xc000063fa0 pc=0x499785
2023-06-23 03:52:40 runtime.gcenable.func2()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc000063fe0 sp=0xc000063fc8 pc=0x4904c6
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcenable
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:179 +0xaa
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 5 [finalizer wait]:
2023-06-23 03:52:40 runtime.gopark(0x1a0?, 0x1eda1c0?, 0x60?, 0x78?, 0xc000062770?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062628 sp=0xc000062608 pc=0x4af116
2023-06-23 03:52:40 runtime.runfinq()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000627e0 sp=0xc000062628 pc=0x48f567
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.createfing
2023-06-23 03:52:40     /usr/local/go/src/runtime/mfinal.go:163 +0x45
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 6 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000064750 sp=0xc000064730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000647e0 sp=0xc000064750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000647e8 sp=0xc0000647e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 18 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00005e750 sp=0xc00005e730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00005e7e0 sp=0xc00005e750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00005e7e8 sp=0xc00005e7e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 19 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00005ef50 sp=0xc00005ef30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00005efe0 sp=0xc00005ef50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00005efe8 sp=0xc00005efe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 20 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00005f750 sp=0xc00005f730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00005f7e0 sp=0xc00005f750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00005f7e8 sp=0xc00005f7e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 21 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00005ff50 sp=0xc00005ff30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00005ffe0 sp=0xc00005ff50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 22 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060750 sp=0xc000060730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000607e0 sp=0xc000060750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000607e8 sp=0xc0000607e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 23 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060f50 sp=0xc000060f30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000060fe0 sp=0xc000060f50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000060fe8 sp=0xc000060fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 24 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061750 sp=0xc000061730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000617e0 sp=0xc000061750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000617e8 sp=0xc0000617e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 25 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061f50 sp=0xc000061f30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000061fe0 sp=0xc000061f50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 26 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000498750 sp=0xc000498730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004987e0 sp=0xc000498750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004987e8 sp=0xc0004987e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 27 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000498f50 sp=0xc000498f30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000498fe0 sp=0xc000498f50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000498fe8 sp=0xc000498fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 28 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000499750 sp=0xc000499730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004997e0 sp=0xc000499750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004997e8 sp=0xc0004997e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 29 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000499f50 sp=0xc000499f30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000499fe0 sp=0xc000499f50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000499fe8 sp=0xc000499fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 30 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00049a750 sp=0xc00049a730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00049a7e0 sp=0xc00049a750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00049a7e8 sp=0xc00049a7e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 31 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00049af50 sp=0xc00049af30 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00049afe0 sp=0xc00049af50 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00049afe8 sp=0xc00049afe0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 32 [GC worker (idle)]:
2023-06-23 03:52:40 runtime.gopark(0x22f38c0?, 0x1?, 0x46?, 0x24?, 0x0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00049b750 sp=0xc00049b730 pc=0x4af116
2023-06-23 03:52:40 runtime.gcBgMarkWorker()
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00049b7e0 sp=0xc00049b750 pc=0x492291
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00049b7e8 sp=0xc00049b7e0 pc=0x4de2e1
2023-06-23 03:52:40 created by runtime.gcBgMarkStartWorkers
2023-06-23 03:52:40     /usr/local/go/src/runtime/mgc.go:1199 +0x25
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 7 [select]:
2023-06-23 03:52:40 runtime.gopark(0xc000496710?, 0x2?, 0x0?, 0x0?, 0xc0004966e4?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000073d30 sp=0xc000073d10 pc=0x4af116
2023-06-23 03:52:40 runtime.selectgo(0xc000073f10, 0xc0004966e0, 0x0?, 0x0, 0x0?, 0x1)
2023-06-23 03:52:40     /usr/local/go/src/runtime/select.go:327 +0x7be fp=0xc000073e70 sp=0xc000073d30 pc=0x4bec9e
2023-06-23 03:52:40 github.com/go-skynet/LocalAI/api.(*galleryApplier).start.func1()
2023-06-23 03:52:40     /build/api/gallery.go:103 +0xe6 fp=0xc000073fe0 sp=0xc000073e70 pc=0x97d7a6
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by github.com/go-skynet/LocalAI/api.(*galleryApplier).start
2023-06-23 03:52:40     /build/api/gallery.go:101 +0xaa
2023-06-23 03:52:40 
2023-06-23 03:52:40 goroutine 8 [sleep]:
2023-06-23 03:52:40 runtime.gopark(0x4b72382d511?, 0xc000496f88?, 0x65?, 0xe5?, 0xc0000c0ad0?)
2023-06-23 03:52:40     /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000496f58 sp=0xc000496f38 pc=0x4af116
2023-06-23 03:52:40 time.Sleep(0x2540be400)
2023-06-23 03:52:40     /usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000496f98 sp=0xc000496f58 pc=0x4db155
2023-06-23 03:52:40 github.com/valyala/fasthttp.(*workerPool).Start.func2()
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:67 +0x56 fp=0xc000496fe0 sp=0xc000496f98 pc=0x837e16
2023-06-23 03:52:40 runtime.goexit()
2023-06-23 03:52:40     /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000496fe8 sp=0xc000496fe0 pc=0x4de2e1
2023-06-23 03:52:40 created by github.com/valyala/fasthttp.(*workerPool).Start
2023-06-23 03:52:40     /go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:59 +0xdd
mudler commented 1 year ago

@dillfrescott likely need more context here. did you run an inference correctly with #659 ?

dillfrescott commented 1 year ago

I think it was user error. It seems to be working now for generic requests at least :D

dillfrescott commented 1 year ago

Not really sure what caused it though

localai-bot commented 1 year ago

:warning::warning::warning::warning::warning:

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

_but.... I can also be funny or helpful :smilecat: and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me, I don't support (yet) replying!

:warning::warning::warning::warning::warning:

Based on the logs provided, it seems like there is a crash in the LocalAI open source project due to a panic. The issue could be related to a programming error or a bug in the code. It might be helpful to check the code for any potential issues and try to reproduce the problem to find a solution. Additionally, it may be useful to check the logs for any other errors or warnings that could provide more information about the issue.

Sources: