search

databricks / megablocks

Apache License 2.0
1.11k stars 154 forks source link

Mem opt glu bkwd #72

Closed mvpatel2000 closed 6 months ago

mvpatel2000 commented 6 months ago

Adds memory optimized backward pass for GLU.

Along for ride, syntax fixes for other runs