search

databricks / megablocks

Apache License 2.0
1.11k stars 154 forks source link

Fix AMP for memory optimized options #111

Closed mvpatel2000 closed 1 month ago

mvpatel2000 commented 1 month ago

Correctly casts inputs/weights in right precision for AMP, which may not operate correctly otherwise