sme paradigm generation does not work, sma is ok (Bugzilla Bug 1360)

[albbas]

This issue was created automatically with bugzilla2github

Bugzilla Bug 1360

Date: 2012-05-19T12:08:27+02:00 From: Trond Trosterud <> To: Ciprian Gerstenberger <> CC: ciprian.gerstenberger, sjur.n.moshagen

Last updated: 2012-09-29T08:17:32+02:00

[albbas]

Comment 6342

Date: 2012-05-19 12:08:27 +0200 From: Trond Trosterud <>

~/main/gt/sme/testing$make n-paradigm WORD=viessu Makefile:257: warning: overriding commands for target n-g.summary' Makefile:145: warning: ignoring old commands for targetn-g.summary' Makefile:266: warning: overriding commands for target n-a.summary' Makefile:154: warning: ignoring old commands for targetn-a.summary' Makefile:286: warning: overriding commands for target n-paradigm' Makefile:174: warning: ignoring old commands for targetn-paradigm' make[1]: Nothing to be done for `isme-norm.fst'.

Running the paradigm generator for 'viessu'

xfst -utf8 < ../../tmp/n-paradigm-gtest-script > Gen_tmp/default/viessu_a.paradigm 0%>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>100% May 19, 2012 09:46:44 GMT Closing 'n-para.ptest'

ERROR: fopen_text_file() failed. make: *** [n-paradigm] Error 1 ~/main/gt/sme/testing$

Verbs work. But for adjectives I get:

~/main/gt/sme/testing$make a-paradigm WORD=ođas Makefile:257: warning: overriding commands for target n-g.summary' Makefile:145: warning: ignoring old commands for targetn-g.summary' Makefile:266: warning: overriding commands for target n-a.summary' Makefile:154: warning: ignoring old commands for targetn-a.summary' Makefile:286: warning: overriding commands for target n-paradigm' Makefile:174: warning: ignoring old commands for targetn-paradigm' make: *** No rule to make target `a-paradigm'. Stop.

[albbas]

Comment 6666

Date: 2012-09-02 10:25:54 +0200 From: Trond Trosterud <>

The bug is still open: paradigm for nouns, not for adjectives and verbs.

[albbas]

Comment 6667

Date: 2012-09-02 13:07:02 +0200 From: Ciprian Gerstenberger <>

1. test: make a-paradigm WORD=ođas Makefile:257: warning: overriding commands for target n-g.summary' Makefile:145: warning: ignoring old commands for targetn-g.summary' Makefile:266: warning: overriding commands for target n-a.summary' Makefile:154: warning: ignoring old commands for targetn-a.summary' Makefile:286: warning: overriding commands for target n-paradigm' Makefile:174: warning: ignoring old commands for targetn-paradigm' make: *** No rule to make target `a-paradigm'. Stop.

2. test: testing>make n-paradigm WORD=ođas Makefile:257: warning: overriding commands for target n-g.summary' Makefile:145: warning: ignoring old commands for targetn-g.summary' Makefile:266: warning: overriding commands for target n-a.summary' Makefile:154: warning: ignoring old commands for targetn-a.summary' Makefile:286: warning: overriding commands for target n-paradigm' Makefile:174: warning: ignoring old commands for targetn-paradigm'

Creating the n paradigm input file for 'ođas'

umask 007 && \ ../../script/testing/merge-codesNword.pl codes/default/n-codes.txt ođas > n-para.ptest *** Word decoded is: ođas make[1]: Nothing to be done for `isme-norm.fst'.

Running the paradigm generator for 'ođas'

xfst -utf8 < ../../tmp/n-paradigm-gtest-script > Gen_tmp/Para_tmp/ođas_a.paradigm 0%>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>100% September 02, 2012 10:56:07 GMT

Result is: testing>ls Gen_tmp/Para_tmp/ođas_a.paradigm Gen_tmp/Para_tmp/ođas_a.paradigm

testing>less Gen_tmp/Para_tmp/ođas_a.paradigm Opening input file '../bin/isme-norm.fst' September 02, 2012 09:19:13 GMT Closing input file '../bin/isme-norm.fst' Opening input file 'n-para.ptest'

ođas+N+Sg+Nom ođas

ođas+N+Sg+Gen ođđasa

Ergo: the noun paradigm for the n-paradigm but with the adj-tag in the output file name "ođas_a.paradigm "!!!

There are a couple of things to fix in this halfway generalized targets. If you really want to try a generation pipeline that works just use the simplified make-gen-dict file. You don't need to use the dict code-files, just give a different parameter for PARATYPE. Examples tried: make -f make-gen-dict paradigm POS=a WORD=ođas PARATYPE=dict make -f make-gen-dict paradigm POS=n WORD=ođas PARATYPE=dict make -f make-gen-dict paradigm POS=v WORD=ođas PARATYPE=dict

NB: the target is not "a-paradigm" but just paradigm plus the pos value as parameter. Much nicer, much cleaner.

(In reply to comment #1)

The bug is still open: paradigm for nouns, not for adjectives and verbs.

[albbas]

Comment 6699

Date: 2012-09-06 09:14:28 +0200 From: Trond Trosterud <>

The testing/Makefile is broken. It does not generate Gen_tmp/Par_tmp catalogues.

Awaiting a fix I use the dict command:

make -f make-gen-dict paradigm POS=a WORD=ođas PARATYPE=dict

But a fst parameter is missing

[albbas]

Comment 6703

Date: 2012-09-06 10:51:25 +0200 From: Ciprian Gerstenberger <>

Actually, no, this is not the case! The PARATYPE parameter seems to trigger both code files (default, dict, oahpa) AND fst.

I tested it with all three parameter values:

1. default:

   Opening input file '../bin/isme-norm.fst' September 06, 2012 08:44:02 GMT Closing input file '../bin/isme-norm.fst' Opening input file 'a-para.ptest'

ođas+A+Attr ođđa

2. dict

   Opening input file '../bin/dict-isme-norm.fst' September 06, 2012 08:43:19 GMT Closing input file '../bin/dict-isme-norm.fst' Opening input file 'a-para.ptest'

ođas+A+Attr ođđa

3. oahpa

   Opening input file '../bin/oahpa-isme-norm.fst' September 06, 2012 08:45:03 GMT Closing input file '../bin/oahpa-isme-norm.fst' Opening input file 'a-para.ptest'

ođasA+Attr ???

Conslusions:

1. it seems that default and dict use the same fat
2. for oahpa, you/we have to tune the generation input for the fst: ođasA+Attr or perhaps the code files

Speaking of the generation of "a" vs. "an", Trond: In your sentence below, I my system would generate "an", not "a"!

(In reply to comment #3)

But a fst parameter is missing

[albbas]

Comment 6704

Date: 2012-09-06 11:22:09 +0200 From: Ciprian Gerstenberger <>

Finetuned and tested the make-gen-dict makefile to accomplish Tronds needs.

1. case (no PARATYPE parameter ==> default) gets isme-norm.fst make -f make-gen-dict paradigm POS=a WORD=ođas

   Opening input file '../bin/isme-norm.fst' September 06, 2012 08:44:02 GMT Closing input file '../bin/isme-norm.fst' Opening input file 'a-para.ptest'

ođas+A+Attr ođđa

2. case (PARATYPE=default) as 1. case make -f make-gen-dict paradigm POS=a WORD=ođas PARATYPE=default

   Opening input file '../bin/isme-norm.fst' September 06, 2012 08:44:02 GMT

3. case make -f make-gen-dict paradigm POS=a WORD=ođas PARATYPE=dict

   Opening input file '../bin/dict-isme-norm.fst' September 06, 2012 08:43:19 GMT Closing input file '../bin/dict-isme-norm.fst' Opening input file 'a-para.ptest'

ođas+A+Attr ođđa

4. case make -f make-gen-dict paradigm POS=a WORD=ođas PARATYPE=oahpa

   Opening input file '../bin/oahpa-isme-norm.fst' September 06, 2012 08:45:03 GMT

(In reply to comment #3)

But a fst parameter is missing

[albbas]

Comment 6860

Date: 2012-09-20 17:34:21 +0200 From: Sjur Nørstebø Moshagen <>

This bug has in practice been overtaken by Ciprian. Moving it to him. I will concentrate on getting paradigm generation to work in the new infra. Ok?

[albbas]

Comment 6863

Date: 2012-09-20 21:47:59 +0200 From: Ciprian Gerstenberger <>

Ok. (In reply to comment #6)

Ok?

[albbas]

Comment 6971

Date: 2012-09-29 08:17:32 +0200 From: Trond Trosterud <>

This means we close this bug. Ciprian's dictionary generation procedures works for ordinary paradigm generation as well (in the old infra), and Sjur is not going to fix the general generation there, but do it in the new infra. We close.