watcher60
commented
1 year ago Probably better to post in the LocalAI project than here -- I would check you have Python3.10 or later as that tripped me up before (and got me to upgrade my Ubuntu to 22.04) and your processor supports AVX/AVX2
aorumbayev
Error while loading model
After starting the server and AutoGPT, an error occurs:
`[127.0.0.1]:42798 404 - GET / 9:18PM DBG Request received: {"model":"gpt-3.5-turbo","file":"","language":"","response_format":"","size":"","prompt":null,"instruction":"","input":null,"stop":null,"messages":[{"role":"system","content":"\nYour task is to devise up to 5 highly effective goals and an appropriate role-based name (_GPT) for an autonomous agent, ensuring that the goals are optimally aligned with the successful completion of its assigned task.\n\nThe user will provide the task, you will provide only the output in the exact format specified below with no explanation or conversation.\n\nExample input:\nHelp me with marketing my business\n\nExample output:\nName: CMOGPT\nDescription: a professional digital marketer AI that assists Solopreneurs in growing their businesses by providing world-class expertise in solving marketing problems for SaaS, content products, agencies, and more.\nGoals:\n- Engage in effective problem-solving, prioritization, planning, and supporting execution to address your marketing needs as your virtual Chief Marketing Officer.\n\n- Provide specific, actionable, and concise advice to help you make informed decisions without the use of platitudes or overly wordy explanations.\n\n- Identify and prioritize quick wins and cost-effective campaigns that maximize results with minimal time and budget investment.\n\n- Proactively take the lead in guiding you and offering suggestions when faced with unclear information or uncertainty to ensure your marketing strategy remains on track.\n"},{"role":"user","content":"Task: 'create an advertising slogan for a drinking water company \"Darida\"'\nRespond only with the output in the exact format specified in the system prompt, with no explanation or conversation."}],"stream":false,"echo":false,"top_p":0,"top_k":0,"temperature":0,"max_tokens":0,"n":0,"batch":0,"f16":false,"ignore_eos":false,"repeat_penalty":0,"n_keep":0,"mirostat_eta":0,"mirostat_tau":0,"mirostat":0,"seed":0,"mode":0,"step":0} 9:18PM DBG Parameter Config: &{OpenAIRequest:{Model:gpt-3.5-turbo File: Language: ResponseFormat: Size: Prompt: Instruction: Input: Stop: Messages:[] Stream:false Echo:false TopP:0.7 TopK:80 Temperature:0.9 Maxtokens:512 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 Seed:0 Mode:0 Step:0} Name: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:512 F16:false Threads:4 Debug:true Roles:map[] Embeddings:false Backend: TemplateConfig:{Completion: Chat: Edit:} MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 ImageGenerationAssets: PromptStrings:[] InputStrings:[] InputToken:[]}
9:18PM DBG Loading model 'gpt-3.5-turbo' greedly
9:18PM DBG [llama] Attempting to load
9:18PM DBG Loading model llama from gpt-3.5-turbo
9:18PM DBG Loading model in memory from file: models/gpt-3.5-turbo
llama.cpp: loading model from models/gpt-3.5-turbo
error loading model: unrecognized tensor type 4
llama_init_from_file: failed to load model 9:18PM DBG [llama] Fails: failed loading model 9:18PM DBG [gpt4all-llama] Attempting to load 9:18PM DBG Loading model gpt4all-llama from gpt-3.5-turbo 9:18PM DBG Loading model in memory from file: models/gpt-3.5-turbo SIGILL: illegal instruction PC=0xb01f95 m=0 sigcode=2 signal arrived during cgo execution instruction bytes: 0xc5 0xfd 0x6f 0x5 0xe3 0x97 0x24 0x0 0x49 0x8d 0x84 0x24 0xe8 0x14 0x0 0x0
goroutine 9 [syscall]: runtime.cgocall(0x9e8710, 0xc0001ba268) /snap/go/current/src/runtime/cgocall.go:157 +0x5c fp=0xc0001ba240 sp=0xc0001ba208 pc=0x44a4fc github.com/nomic-ai/gpt4all/gpt4all-bindings/golang._Cfunc_load_gptjllama_model(0x2dac800, 0x4) _cgogotypes.go:137 +0x4d fp=0xc0001ba268 sp=0xc0001ba240 pc=0x58892d github.com/nomic-ai/gpt4all/gpt4all-bindings/golang.New({0xc00029c090, 0x14}, {0xc0002ac3e0, 0x2, 0x1?}) /home/waplay/GitClone/autogpt4all/LocalAI/gpt4all/gpt4all-bindings/golang/gpt4all.go:35 +0x145 fp=0xc0001ba2c0 sp=0xc0001ba268 pc=0x588c45 github.com/go-skynet/LocalAI/pkg/model.gpt4allLM.func1({0xc00029c090?, 0xc58d80?}) /home/waplay/GitClone/autogpt4all/LocalAI/pkg/model/initializers.go:110 +0x2a fp=0xc0001ba2f8 sp=0xc0001ba2c0 pc=0x608a0a github.com/go-skynet/LocalAI/pkg/model.(ModelLoader).LoadModel(0xc0001b2a50, {0xc000217960, 0xd}, 0xc0002c00e0) /home/waplay/GitClone/autogpt4all/LocalAI/pkg/model/loader.go:127 +0x1fe fp=0xc0001ba3f0 sp=0xc0001ba2f8 pc=0x60aa1e github.com/go-skynet/LocalAI/pkg/model.(ModelLoader).BackendLoader(0xc0001b2a50, {0xc4809d, 0xd}, {0xc000217960, 0xd}, {0xc0000145d8, 0x1, 0x1}, 0x4) /home/waplay/GitClone/autogpt4all/LocalAI/pkg/model/initializers.go:150 +0x7d2 fp=0xc0001ba4b8 sp=0xc0001ba3f0 pc=0x609412 github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).GreedyLoader(0xc0001b2a50, {0xc000217960, 0xd}, {0xc0000145d8, 0x1, 0x1}, 0x0?) /home/waplay/GitClone/autogpt4all/LocalAI/pkg/model/initializers.go:184 +0x3a5 fp=0xc0001ba600 sp=0xc0001ba4b8 pc=0x609a25 github.com/go-skynet/LocalAI/api.ModelInference({, }, , {{{0xc000217960, 0xd}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}, ...}, ...}, ...) /home/waplay/GitClone/autogpt4all/LocalAI/api/prediction.go:218 +0x145 fp=0xc0001ba8b0 sp=0xc0001ba600 pc=0x944545 github.com/go-skynet/LocalAI/api.ComputeChoices({0xc000035200, 0x5bd}, 0xc000150dc0, 0xc00025a280, 0xc0002092c0?, 0xc84278, 0x4?) /home/waplay/GitClone/autogpt4all/LocalAI/api/prediction.go:517 +0x138 fp=0xc0001bb060 sp=0xc0001ba8b0 pc=0x947c18 github.com/go-skynet/LocalAI/api.chatEndpoint.func2(0xc000134b00) /home/waplay/GitClone/autogpt4all/LocalAI/api/openai.go:361 +0x8ec fp=0xc0001bb220 sp=0xc0001bb060 pc=0x93f80c github.com/gofiber/fiber/v2.(App).next(0xc00013f200, 0xc000134b00) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/router.go:144 +0x1bf fp=0xc0001bb2c8 sp=0xc0001bb220 pc=0x8c4dbf github.com/gofiber/fiber/v2.(Ctx).Next(0xc000238330?) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/ctx.go:913 +0x53 fp=0xc0001bb2e8 sp=0xc0001bb2c8 pc=0x8b0393 github.com/gofiber/fiber/v2/middleware/cors.New.func1(0xc000134b00) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/middleware/cors/cors.go:162 +0x3da fp=0xc0001bb3f0 sp=0xc0001bb2e8 pc=0x8cabda github.com/gofiber/fiber/v2.(Ctx).Next(0xc000061448?) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/ctx.go:910 +0x43 fp=0xc0001bb410 sp=0xc0001bb3f0 pc=0x8b0383 github.com/gofiber/fiber/v2/middleware/recover.New.func1(0xc0000614e8?) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/middleware/recover/recover.go:43 +0xcb fp=0xc0001bb488 sp=0xc0001bb410 pc=0x8d180b github.com/gofiber/fiber/v2.(Ctx).Next(0xc0001b2ae0?) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/ctx.go:910 +0x43 fp=0xc0001bb4a8 sp=0xc0001bb488 pc=0x8b0383 github.com/gofiber/fiber/v2/middleware/logger.New.func3(0xc000134b00) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/middleware/logger/logger.go:121 +0x395 fp=0xc0001bbb30 sp=0xc0001bb4a8 pc=0x8cc455 github.com/gofiber/fiber/v2.(App).next(0xc00013f200, 0xc000134b00) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/router.go:144 +0x1bf fp=0xc0001bbbd8 sp=0xc0001bbb30 pc=0x8c4dbf github.com/gofiber/fiber/v2.(App).handler(0xc00013f200, 0x4cf317?) /home/waplay/go/pkg/mod/github.com/gofiber/fiber/v2@v2.45.0/router.go:171 +0x87 fp=0xc0001bbc38 sp=0xc0001bbbd8 pc=0x8c5007 github.com/gofiber/fiber/v2.(*App).handler-fm(0xc000238000?)