Closed PABannier closed 11 months ago
This PR adds support to mixed precision. The convert.py script generates float16 weight and the forward pass is almost left unchanged. Only the gpt_load function is slightly modified to support the fp16 operations.
convert.py
gpt_load
Closes #58 #12
This PR adds support to mixed precision. The
convert.pyscript generates float16 weight and the forward pass is almost left unchanged. Only thegpt_loadfunction is slightly modified to support the fp16 operations.Closes #58 #12