aliyun / SimAI

Apache License 2.0
111 stars 16 forks source link

Whether the workload generated by aicb simulator supports to express the overlap between computation and communication? #22

Open 32HD opened 1 week ago

Huoyuan100861 commented 4 days ago

Due to the numerous overlap strategies implemented across different frameworks, and the fact that the same overlap strategy can achieve varying overlap rates in different scenarios, it is extremely challenging to implement a unified overlap simulation. In SimAI-Analytical, we have implemented customizable overlap rates for each communication group, which proves to be both concise and efficient.

In the future, we will consider incorporating a visual representation of overlap in the workload.