search

av1d / rk3588_npu_llm_server

Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
MIT License
14 stars 3 forks source link

API #3

Open 3AXAPOB opened 1 month ago

3AXAPOB commented 1 month ago

Please add Ollama API or openai generic api