search

coiled / examples

Examples using Dask and Coiled
17 stars 3 forks source link

Add PyTorch GPU run example #20

Closed mrocklin closed 1 year ago

mrocklin commented 1 year ago

Using Coiled run

Some improvements I'd like to see:

  1. A better example, probably taken from https://github.com/pytorch/examples/tree/main
  2. Remove cluster.shutdown(), and replace with keepalive="1 minute"

cc @jrbourbeau @ntabris

mrocklin commented 1 year ago

Once we're happy here, we should probably also think about how to incorporate this (and more) into docs.

ntabris commented 1 year ago

Cool.

Personally I'd be interested to see an example that trains and returns a model. (No idea how well serializing model back to client will work.)

mrocklin commented 1 year ago

Good idea. I'll try to take a look (although getting a little distracted by other things at the moment)

On Mon, Jul 10, 2023 at 12:50 PM Nat Tabris @.***> wrote:

Cool.

Personally I'd be interested to see an example that trains and returns a model. (No idea how well serializing model back to client will work.)

— Reply to this email directly, view it on GitHub https://github.com/coiled/examples/pull/20#issuecomment-1629434795, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACKZTFG3SU3XBL4LOZILMDXPQ6EXANCNFSM6AAAAAA2EZBSJY . You are receiving this because you authored the thread.Message ID: @.***>

--

https://coiled.io

Matthew Rocklin CEO, Dask Maintainer

mrocklin commented 1 year ago

Ran out of time. Merging now for booth activity