Have a pipeline to introduce Neural Network to ESP32

MarlonMueller / edge-iot

Edge Computing and the Internet of Things

2 stars 0 forks source link

Closed SH02-tech closed 11 months ago

MarlonMueller commented 12 months ago

[x] Build data set #2 and #10 (involves resampling, merging datasets pre-processing: normalization, STFT, mel scale, maybe MFCC -> #12 )
[x] Code to train model #15
[x] Convert trained model to C++ #7

MarlonMueller commented 11 months ago

The pipeline basically exists and works now. Issues might need to be resolved once we integrate everything on the ESP (MFCC - MIC - NN). I added a Jinja template that can generate the required CPP model files (similar to here https://github.com/espressif/esp-dl/blob/master/tutorial/quantization_tool_example/model/mnist_model.hpp). The weights (https://github.com/espressif/esp-dl/blob/master/tutorial/quantization_tool_example/model/mnist_coefficient.cpp) are generated by the quantization.