codes-org / codes

The Co-Design of Exascale Storage Architectures (CODES) simulation framework builds upon the ROSS parallel discrete event simulation engine to provide high-performance simulation utilities and models for building scalable distributed systems simulations
Other
40 stars 16 forks source link

Distinguish between green and black links in a dragonfly group (Imported #153) #153

Closed nmcglo closed 5 years ago

nmcglo commented 7 years ago

Original Issue Author: Misbah Mubarak Original Issue ID: 153 Original Issue URL: https://xgitlab.cels.anl.gov/codes/codes/issues/153


Cray dragonflies have two type of intra-group links i.e. green and blue. Both links are electrical and have a bandwidth of 5.25 GiB/s but for green links connecting Aries within the same chassis, there is one cable between the Aries router. For black links connecting Aries among different chassis, there are 3 cables which means additional bandwidth for Aries connecting different chassis. We need to distinguish these two types of links in the simulation to model the right link bandwidths.

nmcglo commented 7 years ago

Misbah Mubarak:

Functionality to have multiple links between the chassis has been added (Number of links between the chassis can be specified by num_col_chans).

Currently, a round robin channel selection is being made in sequential mode. However reverse handler for the round robin selection is non-intuitive since the function may be called several time when doing adaptive routing and we have to set a different flag every time the state has been modified in the function. Currently, the reverse handler functionality behaves like a randomized channel selection but we will have to find a better way to handle this in optimistic mode. Results of simulation vary slightly but are not significantly different.

nmcglo commented 7 years ago

Misbah Mubarak:

Mentioned in issue #154

nmcglo commented 7 years ago

Misbah Mubarak:

Status changed to closed