Closed duanshengliu closed 1 year ago
好主意,是一个不错的优化trick,如果你有时间的话可以提交一个PR。
The following five patterns can be optimized. If this is meddling, please ignore it.
The following five patterns can be optimized. If this is meddling, please ignore it.
- ReLU6
- ReLU
- Minimum
- Maximum
- Minimum + Maximum
Thanks for your tricks, I will seriously consider your proposal.
Hi,考虑一下把clip_by_value如果最大值是6则改成激活函数relu6感觉会更好些