search

pytorch-ignite / examples

Examples, tutorials, and how-to guides
BSD 3-Clause "New" or "Revised" License
11 stars 12 forks source link

`idist` tutorial #16

Closed Priyansi closed 3 years ago

Priyansi commented 3 years ago

A new advanced standalone tutorial on idist that doesn't rely on comparison as in the blog post Distributed Made Easy with Ignite but focuses more on idist methods like all_reduce and all_gather and broadcast.

Priyansi commented 3 years ago

The latest idea is a short tutorial on collective communication giving motivation for using these functions and how to use them via short code snippets.