search

av1d / rk3588_npu_llm_server

Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
MIT License
14 stars 3 forks source link

Update server.cpp to rkllm 1.0.1 #1

Closed ebw44 closed 4 months ago

ebw44 commented 4 months ago

The RKLLMParam struct and callback function have slightly change in rkllm.h in release 1.0.1. This commit adapt to these changes

av1d commented 4 months ago

Thank you for the update. Tested and works well.