srv init: initializing slots, n_slots = 4
slot init: id 0 | task -1 | new slot n_ctx_slot = 1280
slot init: id 1 | task -1 | new slot n_ctx_slot = 1280
slot init: id 2 | task -1 | new slot n_ctx_slot = 1280
slot init: id 3 | task -1 | new slot n_ctx_slot = 1280
main: model loaded
main: chat template, built_in: 1, chat_example: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
'
main: server is listening on 127.0.0.1:8080 - starting the main loop
srv update_slots: all slots are idle
版本:AiNiee5.1 配置SakuraLLM的窗口:
按照说明进行AiNiee配置,但是接口测试失败