apertium / apertium-regtest

Regression testing system for Apertium language data and translators
https://wiki.apertium.org/wiki/Apertium-regtest
GNU General Public License v3.0
1 stars 0 forks source link

loses accepted-choices after hitting `run` #5

Closed unhammer closed 3 years ago

unhammer commented 3 years ago
 apertium-regtest cli

Running regression tests for apertium-sme-smj
Type `help` for a list of available commands.

Loading corpora...
Corpus sme-smj has 0 lines to be examined.
Corpus sme-smj-pending has 0 lines to be examined.
Corpus sme-smj-regression has 1 lines to be examined.
sme-smj-regression 63 of 181
INPUT:
  Dávda sáhttá dagahit šattalmasa ja oktiišaddama.
EXPECTED OUTPUT:
  Dávdda máhttá sjattalvisáv ja aktijsjaddamav dahkat.
ACTUAL OUTPUT:
  Dávdda máhttá sjattalvisáv ja aktij sjaddamav dahkat.
IDEAL OUTPUTS:
  Dávdda máhttá sjattalvissaj ja aktijsjaddamij vájkkudit.
> a
> run
Running sme-smj
Corpus sme-smj has 0 lines to be examined.
Running sme-smj-pending
Corpus sme-smj-pending has 0 lines to be examined.
Running sme-smj-regression
Corpus sme-smj-regression has 1 lines to be examined.
sme-smj-regression 63 of 181
INPUT:
  Dávda sáhttá dagahit šattalmasa ja oktiišaddama.
EXPECTED OUTPUT:
  Dávdda máhttá sjattalvisáv ja aktijsjaddamav dahkat.
ACTUAL OUTPUT:
  Dávdda máhttá sjattalvisáv ja aktij sjaddamav dahkat.
IDEAL OUTPUTS:
  Dávdda máhttá sjattalvissaj ja aktijsjaddamij vájkkudit.

very annoying if you've carefully accepted/golded/skipped 30 things

mr-martian commented 3 years ago

It doesn't retain changes across run, because all the internal data gets replaced in that process.

As currently set up, the solution is to occasionally type save (or v).

Do you think it would make sense to autosave or prompt if there are unsaved changes before a run?

TinoDidriksen commented 3 years ago

Autosave. If all else fails, there's git history.

unhammer commented 3 years ago

I would actually expect it to save on accept, I don't see any point in a separate save command

mr-martian commented 3 years ago

for some reason I had a notion in my head of minimizing file writes, but I'm definitely not doing that with the web interface...

unhammer commented 3 years ago

I don't think most people type that fast =D