search

kamalkraj / ALBERT-TF2.0

ALBERT model Pretraining and Fine Tuning using TF2.0
Apache License 2.0
200 stars 45 forks source link

training parameter #8

Closed shawei3000 closed 5 years ago

shawei3000 commented 5 years ago

when you run squad 2.0 training, you used default value for "version_2_with_negative", which is false, should you be using "True" instead?

kamalkraj commented 5 years ago

Hi @shawei3000, in create_finetuning_data.py version_2_with_negative is only used to write metadata files. SQuAD.json to tfrecords conversion is will handle both squad 1.1 and 2.0 without specifying flags.

In run_squad.py i have used the flag version_2_with_negative