guotong1988 / BERT-GPU

multi-gpu pre-training in one machine for BERT from scratch without horovod (Data Parallelism)
Apache License 2.0
173 stars 54 forks source link

ImportError: No module named 'tensorflow.python.distribute.cross_device_ops' #10

Closed yumath closed 5 years ago

yumath commented 5 years ago

I have used TensorFlow-gpu-1.12.0 to run run_pretraining_gpu_v2.py, but got this problem. Is the version I am using wrong?

guotong1988 commented 5 years ago

???

yick2232 commented 5 years ago

I have used TensorFlow-gpu-1.12.0 to run run_pretraining_gpu_v2.py, but got this problem. Is the version I am using wrong?

So, how to solve it? Which version for Tensorflow? I got same problem.