kyegomez / zeta

Build high-performance AI models with modular building blocks
https://zeta.apac.ai
Apache License 2.0
320 stars 28 forks source link

feat/init-experimentals-activations #190

Closed dtunai closed 2 months ago

dtunai commented 3 months ago

This MR introduces experimental module featuring custom activation methods for the Triton Language. Additionally, this new experimental module will be where a lot of low-level kernels will be kept later.