search

modelscope / 3D-Speaker

A Repository for Single- and Multi-modal Speaker Verification, Speaker Recognition and Speaker Diarization
Apache License 2.0
1.08k stars 94 forks source link

关于learning rate #26

Closed JINzezhong7 closed 1 year ago

JINzezhong7 commented 1 year ago

我用了你的cosine schedule之后，我发现我的learning rate 每轮都在增加。但是不应该是从0.2cosine schedule减小到0.00005吗

image

这个是我的learning rate变化到结果

JINzezhong7 commented 1 year ago
image image

这个是我有关learning rate的代码设置

yfchenlucky commented 1 year ago

sv-rdino/speakerlab/utils/utils_rdino.py中函数cosine_scheduler使得learning rate先增后降。 可以仔细阅读代码再提问哈