Can this deal with complex numbers?

Luolc / AdaBound

An optimizer that trains as fast as Adam and as good as SGD.

https://www.luolc.com/publications/adabound/

Apache License 2.0

2.9k stars 330 forks source link

Can this deal with complex numbers? #26

Open ni-chen opened 2 years ago

ni-chen commented 2 years ago

Hi authors,

I intended to use this method on complex numbers and it turned out with a error message like:

File "optimizer.py", line 701, in step step_size.div_(denom).clamp_(lower_bound, upper_bound).mul_( RuntimeError: "clamp_scalar_cpu" not implemented for 'ComplexFloat'

I'm wondering if it's possible to improve this for complex numbers? Thanks.