You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Hey there, Ross! First off, thanks for this amazing library. Then, I need weights of Vision transformer models pretrained only on the ImageNet1K for my project.
Describe the solution you'd like
For different ViT models, I downloaded weights pretrained on ImageNet1K from the google repository, but I wonder how I can convert those weights. I would be grateful if you could share the converted weights of the models pretrained only on the ImageNet1K.
The text was updated successfully, but these errors were encountered:
There are some in1k weights from Google (How to train your vit paper) on main branch / 0.8.x pre-releases. There were no in1k vit weights before that, they were all 21k pretrained. None of the Google in1k vit weights are very good, only the DeiT in1k weights are decent, there really isn't much architecture difference of note for deit other than layer scale.
I see! I would use the older version, but now, I can fine-tune those models. I have got another question; I wonder if there is any convolutional network pretrained on ImageNet21K and fine-tuned on ImageNet1K with the input imagesize of 224. I think I would be able to use the shared ConvNext weights, but what about other models?
Thanks for your time and consideration!
Is your feature request related to a problem? Please describe.
Hey there, Ross! First off, thanks for this amazing library. Then, I need weights of Vision transformer models pretrained only on the ImageNet1K for my project.
Describe the solution you'd like
For different ViT models, I downloaded weights pretrained on ImageNet1K from the google repository, but I wonder how I can convert those weights. I would be grateful if you could share the converted weights of the models pretrained only on the ImageNet1K.
The text was updated successfully, but these errors were encountered: