Tests (jenkins) to show Avona (AEC+IC), C = Python

xmos / fwk_voice

Voice Framework

Other

11 stars 19 forks source link

Tests (jenkins) to show Avona (AEC+IC), C = Python #348

Closed shuchitak closed 2 years ago

shuchitak commented 2 years ago

[x] Run pipeline test on Avona (AEC +IC)
[x] Run pipeline test on Python (AEC+IC)
[x] Compare keywords
[x] Automate on Jenkins (build AEC+IC python pipeline in Avona)

shuchitak commented 2 years ago

I've added support as part of https://github.com/xmos/fwk_voice/pull/347 for all of the above except the automating it part. Automating it would increase the test time by an hour since we'll first run the full pipeline, then the AEC+IC pipeline to compare against python. I'm leaning towards automating it anyway at the cost of increased test time.

shuchitak commented 2 years ago

AEC+IC pipeline test results:

XCORE results_Avona_aec_ic_prev_arch_xcore.csv

PYTHON results_Avona_aec_ic_prev_arch_python.csv

shuchitak commented 2 years ago

Keyword test wise, AEC+IC Avona and Python pipelines are very similar. Tests for this are automated as part of the Jenkins run and the results_Avona_aec_ic_prev_arch_xcore.csv and results_Avona_aec_ic_prev_arch_python.csv files in the artifacts have the keyword scores logged for Avona and python.

Further investigation of C-python similarity will be done as part of #356