av1d / rk3588_npu_llm_server

Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
MIT License
12 stars 3 forks source link