search

AI-Hypercomputer / maxtext

A simple, performant and scalable Jax LLM!
Apache License 2.0
1.53k stars 293 forks source link

Give user option for activation type precision #906

Closed gobbleturk closed 1 month ago

gobbleturk commented 1 month ago

Give user option for activation type precision

With this option on, we see a slight degradation in performance ~2%