google-research / language

Shared repository for open-sourced projects from the Google AI Language team.
https://ai.google/research/teams/language/
Apache License 2.0
1.6k stars 344 forks source link

Fine Tune Script ReadMe Description Error #46

Open zzj0402 opened 4 years ago

zzj0402 commented 4 years ago

There is an error in the script for fine tuning the bert baseline: --train_precomputed=nq-train.tfrecords-00000-of-00001 \ should be --train_precomputed_file=bert-joint-baseline/nq-train.tfrecords-00000-of-00001 \

python -m language.question_answering.bert_joint.run_nq \
  --logtostderr \
  --bert_config_file=bert-joint-baseline/bert_config.json \
  --vocab_file=bert-joint-baseline/vocab-nq.txt \
  --train_precomputed_file=bert-joint-baseline/nq-train.tfrecords-00000-of-00001 \
  --train_num_precomputed=494670 \
  --learning_rate=3e-5 \
  --num_train_epochs=1 \
  --max_seq_length=512 \
  --save_checkpoints_steps=5000 \
  --init_checkpoint=uncased_L-24_H-1024_A-16/bert_model.ckpt \
  --do_train \
  --output_dir=bert_model_output
rrajp commented 4 years ago

Same error occurred with me. I struggled with code only to realize this silly mistake.

Syauri commented 4 years ago

Where can I find uncased_L-24_H-1024_A-16/bert_model.ckpt?

zzj0402 commented 4 years ago

Where can I find uncased_L-24_H-1024_A-16/bert_model.ckpt?

https://storage.googleapis.com/bert_models/2019_05_30/wwm_uncased_L-24_H-1024_A-16.zip

Syauri commented 4 years ago

Thanks!