I tried to train MaSIF-site and got the following. It is still training, but slowly.
2021-11-10 14:06:26.243439: W tensorflow/core/common_runtime/colocation_graph.cc:983] Failed to place the graph without changing the devices of some resources. Some of the operations (that had to be colocated with resource generating operations) are not supported on the resources' devices. Current candidate devices are [
/job:localhost/replica:0/task:0/device:CPU:0].
See below for details of this colocation group:
Colocation Debug Info:
Colocation group had the following types and supported devices:
Root Member(assigned_device_name_index_=-1 requested_device_name_='/device:GPU:1' assigned_device_name_='' resource_device_name_='/device:GPU:1' supported_device_types_=[CPU] possible_devices_=[]
Identity: CPU XLA_CPU XLA_GPU
Assign: CPU
Const: CPU XLA_CPU XLA_GPU
ApplyAdam: CPU
VariableV2: CPU
Colocation members, user-requested devices, and framework assigned devices, if any:
fully_connected_3/biases/Initializer/zeros (Const)
fully_connected_3/biases (VariableV2) /device:GPU:1
fully_connected_3/biases/Assign (Assign) /device:GPU:1
fully_connected_3/biases/read (Identity) /device:GPU:1
fully_connected_3/biases/Adam/Initializer/zeros (Const) /device:GPU:1
fully_connected_3/biases/Adam (VariableV2) /device:GPU:1
fully_connected_3/biases/Adam/Assign (Assign) /device:GPU:1
fully_connected_3/biases/Adam/read (Identity) /device:GPU:1
fully_connected_3/biases/Adam_1/Initializer/zeros (Const) /device:GPU:1
fully_connected_3/biases/Adam_1 (VariableV2) /device:GPU:1
fully_connected_3/biases/Adam_1/Assign (Assign) /device:GPU:1
fully_connected_3/biases/Adam_1/read (Identity) /device:GPU:1
Adam/update_fully_connected_3/biases/ApplyAdam (ApplyAdam) /device:GPU:1
save/Assign_62 (Assign) /device:GPU:1
save/Assign_63 (Assign) /device:GPU:1
save/Assign_64 (Assign) /device:GPU:1
Hi.
I tried to train MaSIF-site and got the following. It is still training, but slowly.