Smooth ReLU activation implementation as Triton kernel

kyegomez / zeta

Build high-performance AI models with modular building blocks

https://zeta.apac.ai

Apache License 2.0

320 stars 28 forks source link

Closed dtunai closed 2 months ago

dtunai commented 2 months ago

Description: Introduces Smooth ReLU from Google Research as a Triton computation inside Zeta library
Issue: None
Dependencies:None
Tag maintainer: @kyegomez
Twitter handle:@simudt