search

coiled / feedback

A place to provide Coiled feedback
14 stars 3 forks source link

Examples using PyTorch with GPU workers #164

Open phobson opened 2 years ago

phobson commented 2 years ago

via Zendesk https://coiled.zendesk.com/agent/tickets/81

A user on Zendesk wrote:

We want to perform inference using Pytorch on GPU workers. Can someone suggest the docker images that would work? I haven't been able to get the pytorch to detect the gpus in the worker machines.

Further discussion reveals:

I have even tried creating g5.2xlarge instance that have gpus. Problem I am facing is that the pytorch is not recognizing the drivers and gives cues.is_isavalaible false. Is there a working example or tutorial that uses pytorch with gpu that coiled can share with me?

After this, the user said that would provide an example notebook (May 9). That never materialized, but I think we should be able to pull an example from the PyTorch docs and run that in Coiled.

shughes-uk commented 1 year ago

I've confirmed pip install torch and then using package sync + gpu cluster works. If anyone wants to write an example it should be unblocked.