There are option(s) in a config file that are not expected

[salehshadi]

   $MARIAN_TRAIN \
         --model model/model.npz --type transformer \
         --train-sets data/train_all.bpe.$src data/train_all.bpe.$tgt \
         --valid-freq 5000 --save-freq 5000 --disp-freq 500 \
         --valid-metrics ce-mean-words perplexity translation \
         --valid-sets data/dev.bpe.$src data/dev.bpe.$tgt \
         --valid-translation-output data/valid.bpe.$src.output --quiet-translation  \
         --log model/train.log --valid-log model/valid.log \
         --mini-batch-fit -w $WORKSPACE  \
         --valid-script-path $valid_script \
         --beam-size 6 --normalize=0.6 \
         --valid-mini-batch 16 \
         --early-stopping 10 --cost-type=ce-mean-words \
         --enc-depth 6 --dec-depth 6 \
         --transformer-preprocess n --transformer-postprocess da \
         --transformer-dropout 0.1 --transformer-dropout-attention 0.1 --transformer-dropout-ffn 0.1 --label-smoothing 0.1 \
         --learn-rate 0.0001 --lr-warmup 8000 --lr-decay-inv-sqrt 8000 --lr-report \
         --optimizer-params 0.9 0.98 1e-09 --clip-norm 5 \
         --exponential-smoothing \
         --devices $GPUS

After the training stops due to no improvement in ce-mean-words, I changed the training data using back-translation, and continued training, it worked when I continued training in the second time. However, in the third time I got the following error message (it happened twice with me using different dataset for different language pairs). Am I missing something here? It looks that I can stop-and-continue training only once!?

[2019-05-26 18:19:02] Error: There are option(s) in a config file that are not expected
[2019-05-26 18:19:02] Error: Aborted from void marian::ConfigParser::parseOptions(int, char**, bool) in /home/tools/marian/src/common/config_parser.cpp:707
[CALL STACK]
[0x55ca08fe1ea9]                                                       + 0x19fea9
[0x55ca08fbd2ba]                                                       + 0x17b2ba
[0x55ca08fbe69d]                                                       + 0x17c69d
[0x55ca08fbe6fd]                                                       + 0x17c6fd
[0x55ca08ec3d7f]                                                       + 0x81d7f
[0x55ca08ea3ad5]                                                       + 0x61ad5
[0x1514c1af6b97]    __libc_start_main                                  + 0xe7
[0x55ca08ec276a]                                                       + 0x8076a

[snukky]

Try to remove the key "version:" from model.npz.yml. I think this issue has been fixed in marian-dev.

[salehshadi]

Thanks alot! removing version key solved the problem.

[adjouama]

Try to remove the key "version:" from model.npz.yml. I think this issue has been fixed in marian-dev.

thanks, this has solved the problem for me also.