New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于优化器和学习率 #17

Open

Lllllolita opened this issue Sep 10, 2022 · 1 comment

Lllllolita commented Sep 10, 2022

请问，Adadelta优化器是自适应更新学习率的，请问您为什么还要对学习率进行余弦调整呢？非常抱歉打扰了，中秋佳节快乐！

Owner

LBH1024 commented Sep 11, 2022

请问，Adadelta优化器是自适应更新学习率的，请问您为什么还要对学习率进行余弦调整呢？非常抱歉打扰了，中秋佳节快乐！

你好，可以看一下论文中提到余弦学习率时所引用的李沐的文章，里面有一些说明和比较。

Repository owner deleted a comment from NicoleSherwood

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment