Popular repositories Loading

1. Adam-mini Adam-mini Public

   Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793

   Python 362 13

2. hessian-spectrum hessian-spectrum Public

   Code for the paper: Why Transformers Need Adam: A Hessian Perspective

   Jupyter Notebook 44 3

3. iclr-blog-track.github.io iclr-blog-track.github.io Public

   Forked from iclr-blog-track/iclr-blog-track.github.io

   ICLR 2022 Blog-Track: Does Adam Converge and When?

   HTML

4. zyushun.github.io zyushun.github.io Public

   Python

5. Finite-Horizon-Stepsize-Rule Finite-Horizon-Stepsize-Rule Public

6. Adam-mini-ICLR-2025-rebuttal-new Adam-mini-ICLR-2025-rebuttal-new Public