search

marian-nmt / marian

Fast Neural Machine Translation in C++
https://marian-nmt.github.io
Other
1.21k stars 227 forks source link

Error: Aborted from static To marian::fastopt_helpers::Convert<To, std::__cxx11::basic_string<char> #411

Open woolz opened 1 year ago

woolz commented 1 year ago

train-marian.yaml.txt I'm trying train my first transform model, but this error appers on execution: @DESKTOP-L5AT9IN:~/git/marian/build$ ./marian -c /mnt/d/align_data/src-tgt-ms-score-12m-bias/train-marian.yaml -d 0 ....

[2023-04-18 02:00:09] [config] word-penalty: 0
[2023-04-18 02:00:09] [config] word-scores: false
[2023-04-18 02:00:09] [config] workspace: 100000
[2023-04-18 02:00:09] [config] Model is being created with Marian v1.12.0 65bf82ff 2023-02-21 09:56:29 -0800
[2023-04-18 02:00:09] Using synchronous SGD
[2023-04-18 02:00:09] [comm] Compiled without MPI support. Running as a single process on DESKTOP-L5AT9IN
[2023-04-18 02:00:09] Synced seed 1681794009
[2023-04-18 02:00:09] Error: Not implemented
[2023-04-18 02:00:09] Error: Aborted from static To marian::fastopt_helpers::Convert<To, std::__cxx11::basic_string<char> >::apply(const string&) [with To = int; std::string = std::__cxx11::basic_string<char>] in /home/ogaith/git/marian/src/common/fastopt.cpp:27

[CALL STACK]
[0x561a33df6d24]    marian::fastopt_helpers::Convert<int,std::__cxx11::basic_string<char,std::char_traits<char>,std::allocator<char>>>::  apply  (std::__cxx11::basic_string<char,std::char_traits<char>,std::allocator<char>> const&) + 0x1b4
[0x561a33df7899]    marian::fastopt_helpers::As<int>::  apply  (marian::FastOpt const&) + 0x7b9
[0x561a33dfc6fa]    marian::fastopt_helpers::As<std::vector<int,std::allocator<int>>>::  apply  (marian::FastOpt const&) + 0xea
[0x561a33f04fac]    std::vector<int,std::allocator<int>> marian::Options::  get  <std::vector<int,std::allocator<int>>>(char const*) const + 0x9c
[0x561a33ef2e7a]    marian::data::CorpusBase::  CorpusBase  (std::shared_ptr<marian::Options>,  bool,  unsigned long) + 0xb2a
[0x561a33f08f3d]    marian::data::Corpus::  Corpus  (std::shared_ptr<marian::Options>,  bool,  unsigned long) + 0x6d
[0x561a33dd2c1b]    marian::Train<marian::SyncGraphGroup>::  run  ()   + 0x1dab
[0x561a33ced348]    mainTrainer  (int,  char**)                        + 0x158
[0x561a33ca445c]    main                                               + 0x3c
[0x7fb78afd7d90]                                                       + 0x29d90
[0x7fb78afd7e40]    __libc_start_main                                  + 0x80
[0x561a33cebf55]    _start                                             + 0x25

I'd enter on marian/src/common/fastopt.cpp:27 and see "Not implemented", how can I get around this?

snukky commented 1 year ago

In your .yaml file, try replacing lines like this one:

train-sets: /mnt/d/align_data/src-tgt-ms-score-12m-bias/shards-marian/corpus.{zh,en}

with proper YAML lists, for example:

train-sets:
  - /mnt/d/align_data/src-tgt-ms-score-12m-bias/shards-marian/corpus.zh
  - /mnt/d/align_data/src-tgt-ms-score-12m-bias/shards-marian/corpus.en