mosaicml / composer

Supercharge Your Model Training

http://docs.mosaicml.com

Apache License 2.0

5.12k stars 415 forks source link

Add precision change to bf16 when using fp8 eval #3427

Closed j316chuck closed 2 months ago

j316chuck commented 3 months ago

What does this PR do?

Add precision change to BF16 when using FP8 eval

What issue(s) does this change relate to?

https://databricks.atlassian.net/browse/GRT-3023