search

usefulsensors / useful-transformers

Efficient Inference of Transformer models
GNU General Public License v3.0
388 stars 36 forks source link

RK3566 support? #33

Open dearbornEndo opened 9 months ago

dearbornEndo commented 9 months ago

Trying to get this to work on my OrangePi 3b and running into taskset: failed to set pid 2139's affinity: Invalid argument

Jojo-A commented 8 months ago

Hi, I'd also love to see support for the smaller Rockchip families. Hardkernel uses the RK3566 on their recently launched ODROID-M1S. Very similar to that is the RK3568 the Hardkernel uses on their ODROID-M1. Both come with internal NPU. But using it with Home Assistants voice assist on these tiny boards is really a PITA with the current implementation of whisper...