Open jinevening opened 3 years ago
Let's fuse RELU with the proceeding operators across CONCAT.
Before
After
This will reduce the number of operators, improving performance in some platforms.
@jinevening , thanks for the idea!
What
Let's fuse RELU with the proceeding operators across CONCAT.
Before
After
Why
This will reduce the number of operators, improving performance in some platforms.