search

Pelochus / ezrknn-llm

Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
Other
59 stars 3 forks source link

RK3588 NPU Drivers Version #9

Closed lzd19981105 closed 2 months ago

lzd19981105 commented 3 months ago

Do you know how to upgrade the npu drivers to 0.9.6 that rkllm needs?

Pelochus commented 2 months ago

Easy way is to change your OS to Ubuntu Rockchip or Armbian:

If you want to update the driver in your current OS there is no easy way, you need to recompile the Linux kernel, haven't managed to do it once so I will not make a guide on it