cadia-lvl / LOBE

LOBE is a recording client made specifically for TTS data collections. It supports multiple collections, single and multi-speaker, and can prompt sentences based on phonetic coverage.
Apache License 2.0
5 stars 5 forks source link

Assign test configurations in a more intelligent way, ensuring balance #26

Open G-Thor opened 3 years ago

G-Thor commented 3 years ago

The current method of assigning configurations to listeners in Latin Square MOS tests uses the number of people who have started the test as its basis. This avoids the race condition when two people are performing the test at the same time but introduces "gaps" when someone starts a test and doesn't complete it.

It would be better to include an additional check whether some configuration has fewer completions than others and prefer those configurations.