Helsinki-NLP / OpusFilter

OpusFilter - Parallel corpus processing toolkit
MIT License
101 stars 18 forks source link

LM paths do not use output_directory #2

Closed yvesscherrer closed 4 years ago

yvesscherrer commented 4 years ago

Hi, I have the following setup:

common:
    output_directory: exp1
...
steps:
  - type: train_ngram
    parameters:
      model: hsb.arpa.gz
...
  - type: filter
      filters:
        - CrossEntropyFilter:
            lm_params:
                - filename: hsb.arpa.gz

The CrossEntropyFilter cannot find the file. If I use filename: exp1/hsb.arpa.gz instead it works, but I find this a bit counterintuitive...

svirpioj commented 4 years ago

Should be now fixed in the nlingual branch.

svirpioj commented 4 years ago

Now fixed also in master.