Hello, I have paid attention to this work for some time, and appreciate your wonderful work. I have some questions to insult you. And I will appreciate it if you can give some illustrations.
I notice that you also code for Adam optimizer when training. So I wonder if there are some differences between those two kinds of optimizers in performance? Is there anyone better than the other when using the same lr for different layers?
Hello, I have paid attention to this work for some time, and appreciate your wonderful work. I have some questions to insult you. And I will appreciate it if you can give some illustrations.
I notice that you also code for Adam optimizer when training. So I wonder if there are some differences between those two kinds of optimizers in performance? Is there anyone better than the other when using the same lr for different layers?