ProxAdam was found to be slow, too slow for realistic purposes, yet there is value in the ability to handle stochastic optimization. Hence this PR replaces the ProxAdam implementation by Adam.
Changes:
Inner loop of m_step handling proximable regularizer removed.
m_step, API, tests and documentation adapted accordingly.
ProxAdam was found to be slow, too slow for realistic purposes, yet there is value in the ability to handle stochastic optimization. Hence this PR replaces the ProxAdam implementation by Adam.
Changes:
m_step
handling proximable regularizer removed.m_step
, API, tests and documentation adapted accordingly.