Version: transformers@3.0.0-alpha.20
Runtime: Vanilla JS (ESM) in browser, no React or Next.js
Environment/Platform
[X] Website/web-app
[ ] Browser extension
[ ] Server-side (e.g., Node.js, Deno, Bun)
[ ] Desktop app (e.g., Electron)
[ ] Other (e.g., VSCode extension)
Description
Trying to create a pipeline with the Phi-3 models
microsoft/Phi-3-mini-4k-instruct-onnx-web or Xenova/Phi-3-mini-4k-instruct which both have external data files, results in a error message that the external data file is not available (which is incorrect, the file exists!),
I am setting use_external_data_format: true and dtype: "q4f16" (or q4 in the case of the Xenova version of the model)
I don't believe this is a dupe of this issue, as I'm not using Node.js
Error: Can't create a session. ERROR_CODE: 1,
ERROR_MESSAGE: Deserialize tensor model.layers.27.mlp.gate_proj.MatMul.weight_Q4 failed.Failed to load external data file ""model_q4f16.onnx_data"", error: Module.MountedFiles is not available.
Reproduction
Try to create a pipeline with use_external_data_format: true e.g.
System Info
Version: transformers@3.0.0-alpha.20 Runtime: Vanilla JS (ESM) in browser, no React or Next.js
Environment/Platform
Description
Trying to create a pipeline with the Phi-3 models microsoft/Phi-3-mini-4k-instruct-onnx-web or Xenova/Phi-3-mini-4k-instruct which both have external data files, results in a error message that the external data file is not available (which is incorrect, the file exists!),
I am setting
use_external_data_format: true
anddtype: "q4f16"
(or q4 in the case of the Xenova version of the model)I don't believe this is a dupe of this issue, as I'm not using Node.js
Reproduction
Try to create a pipeline with
use_external_data_format: true
e.g.