Open Xuyang-FD opened 2 years ago
The removing of activation is organized in the model part. Since the model is organized like LEGO, the activation can be set to be false to restrain its using.
Set relu's inplace parameter to false to disable relu?
How to control degrees of activation removal in this code?