Reproduction of the "Don't Decay the Learning Rate, Increase the Batch Size" conference paper findings by Samuel L. Smith, Pieter-Jan Kindermans, Quoc V. Le: https://openreview.net/pdf?id=B1Yy1BxCZ.
Virginia Tech 2019 fall CS5824 - advanced machine learning final project.
Results and more details can be seen from the following website: Le: https://sites.google.com/view/projectgroup12/.