mjpost / sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
Apache License 2.0
1.03k stars 162 forks source link

__init__.py divergence in 2.4.0 #255

Closed dustalov closed 5 months ago

dustalov commented 7 months ago

The most recent version of the library, 2.4.0, was bumped in 72213e96c387c01df5aa346fcf1a9a1074f98262, without affecting the __init__.py file that had typing issues addressed since 2.3.3. However, the 2.4.0 release in PyPI has a different content of this file from a release before 2.3.3.

```python #!/usr/bin/env python3 # -*- coding: utf-8 -*- # Copyright 2017--2018 Amazon.com, Inc. or its affiliates. All Rights Reserved. # # Licensed under the Apache License, Version 2.0 (the "License"). You may not # use this file except in compliance with the License. A copy of the License # is located at # # http://aws.amazon.com/apache2.0/ # # or in the "license" file accompanying this file. This file is distributed on # an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either # express or implied. See the License for the specific language governing # permissions and limitations under the License. __version__ = '2.4.0' __description__ = 'Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores' from .utils import smart_open, SACREBLEU_DIR, download_test_set # noqa: F401 from .utils import get_source_file, get_reference_files # noqa: F401 from .utils import get_available_testsets, get_langpairs_for_testset # noqa: F401 from .metrics.helpers import extract_word_ngrams, extract_char_ngrams # noqa: F401 from .dataset import DATASETS # noqa: F401 from .metrics import BLEU, CHRF, TER # noqa: F401 # Backward compatibility functions for old style API access (<= 1.4.10) from .compat import corpus_bleu, raw_corpus_bleu, sentence_bleu # noqa: F401 from .compat import corpus_chrf, sentence_chrf # noqa: F401 from .compat import corpus_ter, sentence_ter # noqa: F401 ```

Please update the release in PyPI and create the corresponding release on GitHub so we have the matching code. Currently, updating to 2.4.0 broke our tests due to the returned typing issues. The repository itself contains the correct code missing on PyPI.

https://github.com/mjpost/sacrebleu/blob/72213e96c387c01df5aa346fcf1a9a1074f98262/sacrebleu/__init__.py#L33-L43