Skip to content

Hyperparameters to reproduce ConvNeXt-atto/femto/pico/nano #1671

Answered by rwightman
yuweihao asked this question in General
Discussion options

You must be logged in to vote

@yuweihao There are a set of nano that can be easily adapted to the others, need to adjust batch sizes, scale LR with batch size, generally decrease augmentation + regularization as you decrease size from nano...

https://gist.github.com/rwightman/ee0b02c1e99a0761264d1d1319e95e5b

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Answer selected by yuweihao
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants