Doesnt recognize model type 'modernbert'

[kguruswamy]

System Info

python 3.9.6
optimum==1.23.3
sentence-transformers==3.3.1

Who can help?

@michaelbenayoun

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

I'm running this command to convert a model to onnx:

optimum-cli export onnx --task sentence-similarity --opset 16 --trust-remote-code -m tomaarsen/ModernBERT-base-gooaq modernbert-base-gooaq

I get this error:

ValueError: The checkpoint you are trying to load has model type modernbert but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Expected behavior

Should be able to export to a directory with onnx artifacts

[echarlaix]

Hi @kguruswamy, you are getting this issue as it seems you're using a transformers version which doesn't support ModernBert https://github.com/huggingface/transformers/blob/v4.47.1/src/transformers/models/auto/configuration_auto.py#L1039, ModernBert will be supported in the next transformers release (v4.48) in the meantime you can install transformers from source. The ONNX export of ModernBert models will soon be supported in optimum (integration in #2131)