If I understand correctly there is a synchronization barrier mechanism so all nodes start at the same time. But is there a synchronization mechanism to ensure that all nodes are on the same cycle (or iteration) ? Does a node wait for all other nodes before starting the next round ?
If I understand correctly there is a synchronization barrier mechanism so all nodes start at the same time. But is there a synchronization mechanism to ensure that all nodes are on the same cycle (or iteration) ? Does a node wait for all other nodes before starting the next round ?