xmos / fwk_voice

Voice Framework
Other
11 stars 19 forks source link

Debug step (AEC+IC) C vs Python #351

Closed shuchitak closed 2 years ago

shuchitak commented 2 years ago

Test AEC and IC pipeline in C vs python:

shuchitak commented 2 years ago

AEC + IC C vs python is very close in terms of keywords detected in the pipeline test. AEC+IC C pipeline keywords are close to python with a margin of +-1 and this comparison is automated in the form of a test run on Jenkins.

This is the latest result on current head of develop (http://srv-bri-jcim0:8080/blue/organizations/jenkins/XMOS%2Ffwk_voice/detail/develop/59/pipeline/2741) which prints the difference between AEC+IC C and python pipeline detected keywords.

[2022-08-17T01:11:45.256Z] + python compare_keywords.py results_Avona_aec_ic_prev_arch_xcore.csv results_Avona_aec_ic_prev_arch_python.csv --pass-threshold=1

[2022-08-17T01:11:45.256Z]

[2022-08-17T01:11:45.256Z] Input1 vs Input2 keywords diff

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Clean_XMOS_DUT1_70dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Clean_XMOS_DUT1_80dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Clean_XMOS_DUT1_90dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Clean__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise1_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise1_65dB_XMOS_DUT1_80dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise1_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise1_70dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise1_80dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise2_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise2_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise2_70dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc1_Noise2_80dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Clean_XMOS_DUT1_70dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Clean_XMOS_DUT1_80dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Clean_XMOS_DUT1_90dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Clean__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise1_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise1_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise1_70dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise1_80dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise2_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise2_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise2_70dB__Take1.wav : -1

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc2_Noise2_80dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Clean_XMOS_DUT1_70dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Clean_XMOS_DUT1_80dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Clean_XMOS_DUT1_90dB_Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Clean__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise1_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise1_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise1_70dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise1_80dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise2_60dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise2_65dB__Take1.wav : 0

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise2_70dB__Take1.wav : 1

[2022-08-17T01:11:45.256Z] InHouse_XVF3510v080_v1.2_20190423_Loc3_Noise2_80dB__Take1.wav : 0

Further C vs python testing will happen as part of unit tests comparing adaptive filter functions between python and C that @uvvpavel is working on.