Unbabel / OpenKiwi

Open-Source Machine Translation Quality Estimation in PyTorch
https://unbabel.github.io/OpenKiwi/
GNU Affero General Public License v3.0
229 stars 48 forks source link

Evaluate pipeline cannot deal with `verbose` and `quiet` arguments #82

Closed daandouwe closed 3 years ago

daandouwe commented 3 years ago

Describe the bug The evaluate pipeline cannot be used: it is missing configuration arguments quiet and verbose and Pydantic throws an error.

To Reproduce

kiwi evaluate evaluate.yaml
...
pydantic.error_wrappers.ValidationError: 2 validation errors for Configuration
quiet
  extra fields not permitted (type=value_error.extra)
verbose
  extra fields not permitted (type=value_error.extra)

with evaluate.yaml:

gold_files:
    sentence_scores: <some scores file>

predicted_dir:
    - runs/0/64719031d54b444f988c5ec1cbfc8491
    - runs/0/a31ab711714f4d779023fc9f68fa2c45