search

sugarforever / chat-ollama

ChatOllama is an open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.
MIT License
2.64k stars 412 forks source link

assistant Oops! Response Exception问题 #441

Open jingnorth opened 6 months ago

jingnorth commented 6 months ago

assistant Oops! Response Exception

试了llama3-70b,上述这个回答是否是资源不够的问题，下面是ollama的日志

May 10 21:19:13 wae ollama[14972]: {"function":"process_single_task","level":"INFO","line":1507,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":97,"tid":"140514672760704","times tamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":57 168,"status":200,"tid":"140473610786560","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"POST","msg":"request","params":{},"path":"/tokenize","remote_addr":"127.0.0.1","remote_port" :57168,"status":200,"tid":"140473610786560","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"process_single_task","level":"INFO","line":1507,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":98,"tid":"140514672760704","times tamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":57 170,"status":200,"tid":"140473619179264","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"launch_slot_with_data","level":"INFO","line":830,"msg":"slot is processing task","slot_id":0,"task_id":99,"tid":"140514672760704","timestamp":1715347 153} May 10 21:19:13 wae ollama[14972]: {"function":"update_slots","ga_i":0,"level":"INFO","line":1810,"msg":"slot progression","n_past":647,"n_past_se":0,"n_prompt_tokens_processed":719,"slot_id":0,"ta sk_id":99,"tid":"140514672760704","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"update_slots","level":"INFO","line":1837,"msg":"kv cache rm [p0, end)","p0":647,"slot_id":0,"task_id":99,"tid":"140514672760704","timestamp":17153471 53} May 10 21:24:14 wae ollama[14972]: [GIN] 2024/05/10 - 21:24:14 | 200 | 5m1s | 172.20.0.4 | POST "/api/chat"

sugarforever commented 6 months ago

从这些信息并没有看出什么问题，你有什么线索吗

jingnorth commented 5 months ago

因为CPU运行的，8B正常，70B是否因为运行的慢，是否因为超时所以Response Exception？

jingnorth commented 5 months ago
image
sugarforever commented 5 months ago

出现错误时，ChatOllama侧应该也会有控制台输出，能看到什么异常信息吗？