GreenWaves-Technologies / gap_sdk

SDK for Greenwaves Technologies' GAP8 IoT Application Processor
https://greenwaves-technologies.com/en/gap8-the-internet-of-things-iot-application-processor/
Apache License 2.0
141 stars 78 forks source link

How to use nntool in gapflow for mixed-precision quantisation? #426

Open SUJUSTDO opened 1 month ago

SUJUSTDO commented 1 month ago

Hi, I'm trying to deploy my AI model to gap8 using gapflow, but I always encounter truncated data during quantisation, e.g. all the outputs of a certain layer will be 127 or -128. Therefore, I want to know if nntool can help me directly perform mixed-precision quantisation.