search

zerospeech / benchmarks

A command line tool that helps use the "Zero Ressource Challenge" benchmarks
https://zerospeech.com/toolbox/
GNU General Public License v3.0
8 stars 2 forks source link

Checkpoints for scoring? #21

Open sdrobert opened 1 year ago

sdrobert commented 1 year ago

Hi Nick,

Running the entire gamut of abxLS tasks can take about 5 hours, depending on the machine. I think it would be very helpful to store and retrieve partial results when scoring in order to avoid recomputing the lot in case of a crash. This would be helpful when operating on HPC clusters prone to crashing or preemption.

Thanks for your time, Sean

nhamilakis commented 1 year ago

Hello, yes this is a good idea. I'm not sure if i will have time to work on it right away though.

sdrobert commented 1 year ago

No worries. Thought I'd put it up here as a "nice to have."