Open okbalefthanded opened 7 months ago
A new optimizer that improves upon AdaBelief is proposed in this paper Aida , the optimizer was tested against SGD, Adam, AdamW, Radam, Fromage, and AdaBelief on ResNet, Transformer, and LSTM.
A new optimizer that improves upon AdaBelief is proposed in this paper Aida , the optimizer was tested against SGD, Adam, AdamW, Radam, Fromage, and AdaBelief on ResNet, Transformer, and LSTM.