search

ELITR / SLTev

SLTev is a tool for comprehensive evaluation of (simultaneous) spoken language translation.
8 stars 3 forks source link

SLTev evaluation is taking excessively long #71

Open bhaddow opened 2 years ago

bhaddow commented 2 years ago

Hi

Running SLTev sometimes takes excessively long to evaluate (about 10 minutes). An example is available at http://www.statmt.org/bhaddow/SLTev-slow-mwe/

I run with:

SLTeval  -i ende.teacher.k0.en-de.en.txt.slt en-de.de.txt en-de.en.txt.OStt -f slt ref ostt

Profiling the code, I see that it spends most of its time here: https://github.com/ELITR/SLTev/blob/2d56dd08fc314ba819eec5dcaaae7fc3c86c8559/SLTev/delay_modules.py#L154

I do not know the code well enough to know what the problem is, but (eg) the two loops could be combined, and the iteration should use for x in list rather than range()

best Barry