search

armbian / linux-rockchip

Improved Rockchip Linux
Other
99 stars 142 forks source link

Upgrade RKNPU driver to 0.9.6 #170

Closed Pelochus closed 2 months ago

Pelochus commented 2 months ago

I was able to fix the issue https://github.com/armbian/linux-rockchip/issues/167 on my own. Tried to compile it, seems to work.

This driver version allows to run LLMs on RK3588 and similar chips. Check this out:

amazingfate commented 2 months ago

Just extracting rknpu_driver_0.9.6_20240322.tar.bz2 should work. Why there are so many commits?

Pelochus commented 2 months ago

You are right. I'm redoing that now.

Pelochus commented 2 months ago

Done :)

Anything else to do?

amazingfate commented 2 months ago

@Joshua-Riek any comments about this update?

Joshua-Riek commented 2 months ago

Looks good to me!