coiled / etl-tpch

BSD 3-Clause "New" or "Revised" License
14 stars 1 forks source link

Train a PyTorch model with a GPU #16

Open mrocklin opened 9 months ago

mrocklin commented 9 months ago

Maybe this doesn't make as much sense for this data, but I'd also like to have a model trained with PyTorch on a GPU machine if possible. Probably this is just ...

@task 
@coiled.function(vm_type=..., software=...)
def train_pytorch_model(...):
    do GPU stuff

@flow(...)
def keep_gpu_model_updated(...):
    ...

"How do I use this to train a deep learning model" is a pretty common question. It's valuable to show off that coiled.function makes using GPUs pretty easy.