wenet-e2e / wespeaker

Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit
Apache License 2.0
599 stars 104 forks source link

[runtime] support MNN inference engine #310

Closed cdliang11 closed 2 months ago

cdliang11 commented 2 months ago

Support MNN inference engine:

cdliang11 commented 2 months ago

Benchmark

  1. RTF

    num_threads = 1

    samples_per_chunk = 32000

    Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz

Model Params FLOPs engine RTF
ResNet-34 6.63 M 4.55 G onnxruntime 0.1377
ResNet-34 6.63 M 4.55 G mnn 0.1333
ResNet-34 6.63 M 4.55 G mnn mini_libs 0.05262
cdliang11 commented 2 months ago

这个pr中对rtf做了初步测试,后续会详细对比onnxruntime/MNN/ncnn。:) actions: