Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated model-ema-decay default to 0.9 #4407

Merged

Conversation

prabhat00155
Copy link
Contributor

@prabhat00155 prabhat00155 commented Sep 14, 2021

Updated default value of model-ema-decay to a less extreme value.

cc @datumbox

Copy link
Contributor

@datumbox datumbox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. I confirm I've tested this value on my side and it's reasonable for most models and learning rate schemes.

@prabhat00155 prabhat00155 merged commit 4d92892 into pytorch:main Sep 14, 2021
@prabhat00155 prabhat00155 deleted the prabhat00155/update_ema_default branch September 14, 2021 10:22
facebook-github-bot pushed a commit that referenced this pull request Sep 30, 2021
Reviewed By: datumbox

Differential Revision: D31268035

fbshipit-source-id: 235e82d201b1ca1eb88dfce63e49dacaac90fb88
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants