This pull request adds the deepspeed profiler to the project and updates the flops_counter.py file to calculate model complexity using the deepspeed profiler. Previously, only ptflops and calflops were used for model complexity calculation. With this update, the deepspeed profiler provides additional insights into the model's FLOPs, MACs, and parameters. This enhances the accuracy of the model complexity estimation by using multiple tools to calculate FLOPS
This pull request adds the deepspeed profiler to the project and updates the
flops_counter.py
file to calculate model complexity using the deepspeed profiler. Previously, only ptflops and calflops were used for model complexity calculation. With this update, the deepspeed profiler provides additional insights into the model's FLOPs, MACs, and parameters. This enhances the accuracy of the model complexity estimation by using multiple tools to calculate FLOPS