You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Version: transformers@3.0.0-alpha.20
Runtime: Vanilla JS (ESM) in browser, no React or Next.js
Environment/Platform
Website/web-app
Browser extension
Server-side (e.g., Node.js, Deno, Bun)
Desktop app (e.g., Electron)
Other (e.g., VSCode extension)
Description
Trying to create a pipeline with the Phi-3 models microsoft/Phi-3-mini-4k-instruct-onnx-web or Xenova/Phi-3-mini-4k-instruct which both have external data files, results in a error message that the external data file is not available (which is incorrect, the file exists!),
I am setting use_external_data_format: true and dtype: "q4f16" (or q4 in the case of the Xenova version of the model)
I don't believe this is a dupe of this issue, as I'm not using Node.js
Error: Can't create a session. ERROR_CODE: 1,
ERROR_MESSAGE: Deserialize tensor model.layers.27.mlp.gate_proj.MatMul.weight_Q4 failed.Failed to load external data file ""model_q4f16.onnx_data"", error: Module.MountedFiles is not available.
Reproduction
Try to create a pipeline with use_external_data_format: true e.g.
System Info
Version: transformers@3.0.0-alpha.20
Runtime: Vanilla JS (ESM) in browser, no React or Next.js
Environment/Platform
Description
Trying to create a pipeline with the Phi-3 models
microsoft/Phi-3-mini-4k-instruct-onnx-web or Xenova/Phi-3-mini-4k-instruct which both have external data files, results in a error message that the external data file is not available (which is incorrect, the file exists!),
I am setting
use_external_data_format: true
anddtype: "q4f16"
(or q4 in the case of the Xenova version of the model)I don't believe this is a dupe of this issue, as I'm not using Node.js
Reproduction
Try to create a pipeline with
use_external_data_format: true
e.g.The text was updated successfully, but these errors were encountered: