Closed bhaddow closed 1 year ago
Hi
Actually, when I use a python3.8 within conda, I get the error above. In a python3.8 virtual environment, it works.
Still checking ...
best Barry
In a clean Python 3.8 conda environment, SimulEval works correctly. The problem arises with Python 3.10
This is on the iwslt2023 branch, clean checkout.
Hi @bhaddow Can you try the main branch? BTW did you install from source?
I use python 3.10 it works from me ✓ python --version Python 3.10.10 (test_simuleval) /private/home/xutaima/projects/2022_h2_streaming/SimulEval/examples/quick_start s2s_instructions ✗ 28m
✓ python --version
Python 3.10.10
✓ simuleval --source source.txt --target target.txt --agent agent_with_configs.py --waitk 3 --vocab dict.txt
2023-04-14 13:24:51 | INFO | simuleval.utils.agent | System will run on device: cpu.
2023-04-14 13:24:51 | INFO | simuleval.dataloader | Evaluating from text to text.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 2894.02it/s]
2023-04-14 13:24:51 | INFO | simuleval.sentence_level_evaluator | Results:
BLEU LAAL AL AP DAL ATD
1.639 3.0 3.0 0.676 3.0 3.0
Hi Xutai
With a clean checkout, and a clean environment, it works fine. I tested both iwslt and main branch.
I suspect my original environment was broken in some way
best Barry
Hi
Trying to run the dummy waitk example with Python 3.10 gives the following error:
It works fine for me with Python 3.8
best Barry