Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported in stock DeepSpeed (upstream).
MIT License
56
stars
19
forks
source link
Set overlap_comm=false to use the same stream for computation and compuatation #78
with the overlap_comm=true to use the multi-streams for communication and computation will cause the power limitation and external PROCHOT assertion to limited the frequency to affect the performance, when overlap_comm=false to use the same stream for communication and computation can get better performance.
with the overlap_comm=true to use the multi-streams for communication and computation will cause the power limitation and external PROCHOT assertion to limited the frequency to affect the performance, when overlap_comm=false to use the same stream for communication and computation can get better performance.