Closed RicherMans closed 5 years ago
Enhanced loss to include a weighted average to enhance training stability. Removed tanh from attention, which further enhances stability.
Enhanced loss to include a weighted average to enhance training stability. Removed tanh from attention, which further enhances stability.