majianjia / nnom

A higher-level Neural Network library for microcontrollers.
Apache License 2.0
820 stars 235 forks source link

KWS Keras Model Accuracy #139

Closed HadeelMabrouk closed 2 years ago

HadeelMabrouk commented 2 years ago

Hi,

I was wondering what is the reported accuracy for the Keras model in the KWS example. Here, the reported top-1 acc is reported to be = 83.371195%. However, here it's reported to be around 90%. So, I was wondering if there was a typo in this part.

On the other hand, when I tried to retrain the Keras model (using the old configurations), I only got an accuracy of 81.7%. So, I was wondering what might be the reason for these inconsistencies.

TIA.

majianjia commented 2 years ago

Hi, The training set might be different from time to time (such as volume, noise mixing level, epoch, selected keywords, or the model itself). It might reach around 90% back in time. The accuracy for all 35 keywords will be low, but will increase if you only select 10. You can tune the model once you understand the process.

HadeelMabrouk commented 2 years ago

Noted with thanks.