search

coiled / examples

Examples using Dask and Coiled
17 stars 3 forks source link

Add extended PyTorch Optuna GPU example #9

Closed milesgranger closed 1 year ago

milesgranger commented 1 year ago

This is the same notebook copied from https://github.com/coiled/benchmarks/pull/787, which will be removed before that PR is merged.

I've ran this locally twice now w/o issue. It uses software environment for the cluster so ought to be relatively client independent. Also provides slightly more exciting task stream while keeping GPUs busy; can be adjusted further by adjusting namely the num_epochs for shorter/longer tasks.

cc @mrocklin

review-notebook-app[bot] commented 1 year ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

mrocklin commented 1 year ago

This is great. Thank you @milesgranger . Confirmed that this has nicer utilization. I've simplified the environment definition (less correct, but easier to grok for now). I've also added a plot at the end.

Any talking points that we should know when talking to this example?

milesgranger commented 1 year ago

Thanks @mrocklin! Nothing exceptional to note when talking about this example. Perhaps mostly to serve as a base template they can modify, namely the model and dataset, when applied to the user's applications.