While I was running BERT, suddenly I got the following error message.
'''
inputs, attrs, num_outputs)
tensorflow.python.framework.errors_impl.InvalidArgumentError: No OpKernel was registered to support Op 'NcclAllReduce' used by {{node while/body/_1/AdamWeightDecay/NcclAllReduce}} with these attrs: [reduction="sum", shared_name="c1", T=DT_FLOAT, num_devices=2]
Registered devices: [CPU, GPU, XLA_CPU, XLA_GPU]
Registered kernels:
[[while/body/_1/AdamWeightDecay/NcclAllReduce]] [Op:__inference_train_steps_46285]
'''
I don't know what does it mean. Please Help..
While I was running BERT, suddenly I got the following error message. ''' inputs, attrs, num_outputs) tensorflow.python.framework.errors_impl.InvalidArgumentError: No OpKernel was registered to support Op 'NcclAllReduce' used by {{node while/body/_1/AdamWeightDecay/NcclAllReduce}} with these attrs: [reduction="sum", shared_name="c1", T=DT_FLOAT, num_devices=2] Registered devices: [CPU, GPU, XLA_CPU, XLA_GPU] Registered kernels: