Recently I stumbled upon the Bits&Bytes wrapper. Since then I can't help but wonder whether we could adapt this idea for the second order methods, namely, 8-bit L-BFGS i.e., L-BFGS using an 8-bit state instead of an 32-bit.
I was wondering whata are your initial thoughts on it ?
Hello @hjmshi ,
Recently I stumbled upon the Bits&Bytes wrapper. Since then I can't help but wonder whether we could adapt this idea for the second order methods, namely, 8-bit L-BFGS i.e., L-BFGS using an 8-bit state instead of an 32-bit.
I was wondering whata are your initial thoughts on it ?