I have a few zero-factor rk3566-based devices (radxa zero, radxa zero 3w, geniatech zero).
These have a 1 TOPS NPU vs 6 TOPS in rk3588.
I see that the 3588 has a 6 TOPS NPU which is supported by this repo.
What would it take to try to run these models on the rk3566?
Would it work without changes to try?
Where would I begin if I wanted to try to make it compatible?
I am mostly interested in qwen2:0.5b-instruct or maybe https://huggingface.co/ahxt/LiteLlama-460M-1T if we can get it running.
I have a few zero-factor rk3566-based devices (radxa zero, radxa zero 3w, geniatech zero). These have a 1 TOPS NPU vs 6 TOPS in rk3588. I see that the 3588 has a 6 TOPS NPU which is supported by this repo. What would it take to try to run these models on the rk3566? Would it work without changes to try? Where would I begin if I wanted to try to make it compatible? I am mostly interested in qwen2:0.5b-instruct or maybe https://huggingface.co/ahxt/LiteLlama-460M-1T if we can get it running.
See: https://gadgetversus.com/processor/rockchip-rk3588-vs-rockchip-rk3566/
Thanks!