google / compare-codecs

Apache License 2.0
49 stars 23 forks source link

Verify_scores needs to use old DB to find "best" #77

Closed alvestrand closed 8 years ago

alvestrand commented 8 years ago

At the moment the verify_scores function uses the current scores to find the "best" scores to evaluate whether they have changed or not. This is bad in the case where the "best" score is worsened - the next run of the tool will pick a new configuration as "best".

The solution likely involves moving the choice of scoredir into the optimizer.