sig-rpc / optimisation-ideas

If you have any ideas for trivial optimisations, find/create an issue for the corresponding topic and leave a response.
1 stars 0 forks source link

PyTorch #1

Open Robadob opened 1 month ago

Robadob commented 1 month ago

Not an ML user myself, so some of this advice may be junk.

Robadob commented 1 month ago

Most of it's behind a paid substack, but the gif of 15 ideas is probably something to work from.

image

https://x.com/_avichawla/status/1839609421573312733 https://blog.dailydoseofds.com/p/memory-pinning-to-accelerate-model https://www.dailydoseofds.com/15-ways-to-optimize-neural-network-training-with-implementation/ https://t.co/PApFItRXgL