search

srvk / DiViMe

ACLEW Diarization Virtual Machine
Apache License 2.0
32 stars 9 forks source link

Unclear instructions for evaluation #138

Closed marisacasillas closed 5 years ago

marisacasillas commented 5 years ago

I haven't been able to try the evaluation tool because of #135, however, I noticed that the instructions are less informative than they could be in the docs. In particular:

data/: This second argument tells DiViMe where are the sound files that need to be evaluated. This directory must contain both the annotations generated by the model and the human-made ones.

I assume that it'll look for pairs of outputs like:

...but it's not clear from the example and maybe depends a little too much on the user's understanding of how you've set things up. A little more detail in the example would do the trick, thanks!

alecristia commented 5 years ago

@fmetze just assigning it to you because you were looking over the instructions. The error Middy talks about at the beginning (#135) I'll address in a separate issue. Here, we just need to attend to her pointing out that the instructions are not clear enough

alecristia commented 5 years ago

actually, I'm working on this section, so I'll fix this