AngledLuffa
commented
4 months ago I actually think that's a case of the logging not correctly reflecting the reality. I added some log lines to the parser which should tell you which model it loaded for the retagging. You can try it using the dev branch, if you're comfortable with that. (I will need to make a new release within a day to fix some other issues, anyway.)
Beyond that, I think there's probably something else going wrong... would you post the entire log message?
Kudos for going ahead with the Icelandic parser. I knew that dataset existed, but had not tried to build a model yet.
On Thu, Feb 29, 2024 at 12:54 PM Ingunn Jóhanna Kristjánsdóttir < @.***> wrote:
I am working on adding a constituency model for Icelandic. I used the constituency treebank I have for training a POS tagger but how do I use it when training the constituency model? The instructions say this: "To change to a specific model (such as if you build one yourself) use the --retag_model_path command line flag." but when I try to run this: "python -m stanza.utils.training.run_constituency is_icepahc --retag_model_path saved_models/pos/ is_icepahc_nocharlm_tagger.pt" it still just uses the default pos tagger for Icelandic (which I don't want to use). Do I need to use some more flags, other than --retag_model_path (for example --retag_package?), to make sure it uses my model?
Here is what I get when I only use the flag --retag_model_path saved_models/pos/is_icepahc_nocharlm_tagger.pt: ... retag_method: xpos retag_model_path: saved_models/pos/is_icepahc_nocharlm_tagger.pt retag_package: default retag_pretrain_path: None retag_xpos: True ... And: 2024-02-29 20:46:55 INFO: Reading trees from /stanza/constituency/data/icelandic/processed_data/is_icepahc_train.mrg 2024-02-29 20:47:16 INFO: Read 58394 trees for the training set 2024-02-29 20:47:18 INFO: Filtered 512 duplicates from train dataset 2024-02-29 20:47:18 INFO: Eliminated 3 trees with missing structure 2024-02-29 20:47:18 INFO: Reading trees from /stanza/constituency/data/icelandic/processed_data/is_icepahc_dev.mrg 2024-02-29 20:47:19 INFO: Read 7299 trees for the dev set 2024-02-29 20:47:20 INFO: Filtered 24 duplicates from dev dataset 2024-02-29 20:47:20 INFO: Retagging trees using the xpos tags from the default package... (i.e. not using my model.. and then the training fails after retagging because this default pos tagger is not compatible with my data)
— Reply to this email directly, view it on GitHub https://github.com/stanfordnlp/stanza/issues/1356, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA2AYWOC5ANTDKGII5Q4RJTYV6KRXAVCNFSM6AAAAABEAUJ6QKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGE3DEMBYHEZDOMQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>
ingunnjk
I am working on adding a constituency model for Icelandic. I used the constituency treebank I have for training a POS tagger but how do I use it when training the constituency model? The instructions say this: "To change to a specific model (such as if you build one yourself) use the --retag_model_path command line flag." but when I try to run this: "python -m stanza.utils.training.run_constituency is_icepahc --retag_model_path saved_models/pos/is_icepahc_nocharlm_tagger.pt" it still just uses the default pos tagger for Icelandic (which I don't want to use). Do I need to use some more flags, other than --retag_model_path (for example --retag_package?), to make sure it uses my model?
Here is what I get when I only use the flag --retag_model_path saved_models/pos/is_icepahc_nocharlm_tagger.pt: ... retag_method: xpos retag_model_path: saved_models/pos/is_icepahc_nocharlm_tagger.pt retag_package: default retag_pretrain_path: None retag_xpos: True ... And: 2024-02-29 20:46:55 INFO: Reading trees from /stanza/constituency/data/icelandic/processed_data/is_icepahc_train.mrg 2024-02-29 20:47:16 INFO: Read 58394 trees for the training set 2024-02-29 20:47:18 INFO: Filtered 512 duplicates from train dataset 2024-02-29 20:47:18 INFO: Eliminated 3 trees with missing structure 2024-02-29 20:47:18 INFO: Reading trees from /stanza/constituency/data/icelandic/processed_data/is_icepahc_dev.mrg 2024-02-29 20:47:19 INFO: Read 7299 trees for the dev set 2024-02-29 20:47:20 INFO: Filtered 24 duplicates from dev dataset 2024-02-29 20:47:20 INFO: Retagging trees using the xpos tags from the default package... (i.e. not using my model.. and then the training fails after retagging because this default pos tagger is not compatible with my data)