search

zerospeech / benchmarks

A command line tool that helps use the "Zero Ressource Challenge" benchmarks
https://zerospeech.com/toolbox/
GNU General Public License v3.0
8 stars 3 forks source link

Evaluations for tde15 & abx15 #3

Closed nhamilakis closed 1 year ago

nhamilakis commented 1 year ago

Adding benchmark bindings for tde15 & abx15 requires some research.

ABX

1) what is the subset of the buckeye corpus that is used (or is all the corpus included) 2) what is the subset of the xitsonga corpus that is used (or do i use all the corpus) 3) where are the .item files (this is the most important

TDE

1) same questions 1 & 2 from abx 2) are the gold files in the tde module correct ?

Submissions are nowhere to be found, i should use baseline for testing, maybe a random submission can be created as well.

nhamilakis commented 1 year ago

Will not implement the zrc2015 benchmarks, see #24 for more details