We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
optimum 1.16.1 platform ubuntu-20 python python3.8
No response
examples
due to missing NormalizedConfig registration for phi model, I can not load model using optimum.intel.openvino.OVModelForCausalLM:
from optimum.intel.openvino import OVModelForCausalLM model_id = "susnato/phi-1_5_dev" ov_model = OVModelForCausalLM.from_pretrained(model_id, export=True, compile=False)
as a workaround, if I add before creating the model these lines:
from optimum.utils import NormalizedTextConfig, NormalizedConfigManager NormalizedConfigManager._conf['phi'] = NormalizedTextConfig
it can be successfully loaded. I suppose that these lines missed in https://github.com/huggingface/optimum/blob/main/optimum/utils/normalized_config.py#L210 as it defined in OnnxExportConfig https://github.com/huggingface/optimum/blob/main/optimum/exporters/onnx/model_configs.py#L253 https://github.com/huggingface/optimum/blob/main/optimum/exporters/tasks.py#L816
model converted and loaded without errors
The text was updated successfully, but these errors were encountered:
Hi @eaidova, this should be fixed with #1625
Sorry, something went wrong.
No branches or pull requests
System Info
Who can help?
No response
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
due to missing NormalizedConfig registration for phi model, I can not load model using optimum.intel.openvino.OVModelForCausalLM:
as a workaround, if I add before creating the model these lines:
it can be successfully loaded.
I suppose that these lines missed in
https://github.com/huggingface/optimum/blob/main/optimum/utils/normalized_config.py#L210
as it defined in OnnxExportConfig https://github.com/huggingface/optimum/blob/main/optimum/exporters/onnx/model_configs.py#L253 https://github.com/huggingface/optimum/blob/main/optimum/exporters/tasks.py#L816
Expected behavior
model converted and loaded without errors
The text was updated successfully, but these errors were encountered: