Skip to content

Commit

Permalink
And changing the changed name in the tests.
Browse files Browse the repository at this point in the history
  • Loading branch information
murrellb committed Dec 16, 2024
1 parent c75142f commit b95fd3c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion test/rules.jl
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ RULES = [
OptimiserChain(ClipNorm(), Adam(0.001)),
OptimiserChain(ClipGrad(0.5), Momentum()),
OptimiserChain(WeightDecay(), OAdam(), ClipGrad(1)),
OptimiserChain(GradNormGrowthLimiter(1.1), Apollo()),
OptimiserChain(NormGrowthCap(1.1), Apollo()),
# Not the default:
RMSProp(centred = true), AdamW(couple=false),
]
Expand Down

0 comments on commit b95fd3c

Please sign in to comment.