kokoye2007 / waitzar

Automatically exported from code.google.com/p/waitzar
Other
0 stars 1 forks source link

Add a "Regression Test" module. #113

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Currently, testers have to open WaitZar and manually test whatever it is
they'd like to test. I'd like to automate this. 

At the moment, this automation is only NEEDED for KeyMagic inputs, though
I'd like to extend it eventually to every other IM, perhaps adding tests
for candidate lists, different output languages, etc.

So, for our simple case, we might just use a KeyMagic input file as the
test code:

   uf => U1000 U103A

...clearly explains the type of input and output this test expects. I'd
like to add the ability to open WaitZar in "regression mode", which will
then run through all regression tests and output a log of errors before
exiting. 

Regression mode should be tied to the language (and probably the
input/output encoding, etc.) Therefore, we should consider a configure file
section:

   language.myanmar.regressions.wzsimple : {
      input-manager: waitzar,
      input-encoding: unicode,
      output-encoding: unicode,
      regression-file: reg1.txt
   }

The problem is that running all regressions on all IMs might be too
time-consuming. So, I think we should add a command-line option to WZ: 
   WaitZar.exe -regress _filename_
...which loads a regression test suite from the _filename_ config file.
Regression options are disabled in all other config files, and they always
run if one is detected. Following regressions, WaitZar always shows a
prompt and exits. 

This should be extensible enough for WaitZar's future regression needs; in
addition, it using existing formats and simple configuration logic, so it
shouldn't take too long to implement. We really need this; testers are
going to want to take the newest version of WZ and simply "run my old
tests" without having to manually type them in. 

Original issue reported on code.google.com by seth.h...@gmail.com on 4 May 2010 at 9:53

GoogleCodeExporter commented 9 years ago
We've got this, for "keyboard"s at least. It works on the command line, and 
uses a
header inside the test file itself:

/*
     @language = myanmar
     @input-method = ayar
     @output-encoding = ayar
*/

Original comment by seth.h...@gmail.com on 4 Jun 2010 at 12:15