-
### Describe the feature request
Assess performance capability without downloading the full model.
### Describe scenario use case
For some models, the performance may be a blocker. Since model do…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
报错为
load_model_config modle\chatglm-6b-int4...
Loading modle\chatglm-6b-int4...
No compile…
-
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f2.0.1v1.10.1-previous-335-g4751d664
Commit hash: 4751d6646d3889c4f0acb24d3b5a868a8208fb3a
Launching…
-
Whilst WebGPU support is growing, perhaps it would be prudent to have a WASM backend to ensure 100% device coverage.
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
All versions up to date.
### Reproduction
No code snippet required
### Expected behavior
When is thi…
pbosh updated
1 month ago
-
Hello, Louis.
Currently, I've been using uform-coreml-converters to convert uform models, and they're running great. uform-coreml-converters is indeed a fantastic project, and I'm very grateful for…
-
### 🐛 Describe the bug
The current method to estimate the numerical errors in test_transformers.py is based on the difference b/w results from current precision and higher precision tensors
https:…
-
Error occurred when executing T5TextEncode #ELLA:
"addmm_impl_cpu_" not implemented for 'Half'
File "C:\Users\WarMa\OneDrive\Escritorio\ComfyUI\ComfyUI\execution.py", line 151, in recursive_exec…
-
**Describe the bug**
I'm trying to quantize a fine-tuned Phi-3 model using `builder.py` and I'm running into the error below
Looking at the error message it's because the `configuration_phi3.p…
-
```
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f1.0.2v1.10.1-previous-168-gf743fbff
Commit hash: f743fbff83c7db0bf0957ab9718f8d42a47eb35e
Laun…