marian-nmt / marian-dev

Fast Neural Machine Translation in C++ - development repository
https://marian-nmt.github.io
Other
256 stars 126 forks source link

--force-decode does not work on CPU #1022

Open hdeval1 opened 7 months ago

hdeval1 commented 7 months ago

Bug description

Other marian-decoder functions work, but using --force-decode results in this error

[2024-02-15 18:55:11] Error: CopyCastTo to type uint32 not implemented
[2024-02-15 18:55:11] Error: Aborted from void marian::cpu::CopyCastFrom(marian::Tensor, const T*, int) [with bool add = false; T = float; marian::Tensor = IntrusivePtr<marian::TensorBase>] in /marian/src/tensors/cpu/tensor_operators.cpp:59

How to reproduce

Model: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/kor-eng Using a CPU container with Marian 1.12, no CUDA, and Open BLAS Prefixes.txt file and src.txt file are same amount of lines /marian/build/marian-decoder -c decoder.yml --force-decode --beam-size 10 --cpu-threads=16 --n-best -o output.txt log.txt

Context

Add any other information about the problem here.