I am trying to create a machine with GPU using bentoctl with Google Cloud Engine Operator but I believe the way terraform calls docker run does not consider the --gpus all tag. I think that the solution should be in the module "gce-container" inside the terraform template. The code could be found below:
I am trying to create a machine with GPU using
bentoctl
with Google Cloud Engine Operator but I believe the wayterraform
calls docker run does not consider the--gpus all
tag. I think that the solution should be in themodule "gce-container"
inside the terraform template. The code could be found below:To verify if a GPU really exists in the GCP Virtual Machine I am printing a counter using Tensorflow:
print("Num GPUs Available: ", len(tf.config.list_physical_devices('GPU')))
This is related to this terraform documentation below, but I dont see any GPU related param.