search

guotong1988 / BERT-GPU

multi-gpu pre-training in one machine for BERT from scratch without horovod (Data Parallelism)
Apache License 2.0
173 stars 54 forks source link

ValueError: You must specify an aggregation method to update a MirroredVariable in Tower Context. #8

Closed nlp4whp closed 5 years ago

nlp4whp commented 5 years ago

Does anyone meet this error:

ValueError: You must specify an aggregation method to update a MirroredVariable in Tower Context.

my tensorflow version is 1.10.0, I wanna know whether the tensorflow version causes this error

guotong1988 commented 5 years ago

Try https://github.com/guotong1988/BERT-multi-gpu/blob/master/run_pretraining_gpu_v2.py

nlp4whp commented 5 years ago

Try https://github.com/guotong1988/BERT-multi-gpu/blob/master/run_pretraining_gpu_v2.py

Thanks, it works when I update my tf to 1.12.0