-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
As suggested [here](https://www.tensorflow.org/model_optimization/guide/pruning), model pruning currently only provides benefits in model compression/size reduction. Further framework support is neces…
-
I installed on windows and failing
from torchao.quantization import quantize_
pip freeze
```
Microsoft Windows [Version 10.0.19045.4894]
(c) Microsoft Corporation. All rights reserved.
…
-
- [ ] [Qwen-1.5-8x7B : r/LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/1atw4ud/qwen158x7b/)
# TITLE: Qwen-1.5-8x7B : r/LocalLLaMA
**DESCRIPTION:** "Qwen-1.5-8x7B
New Model
Someone creat…
-
To speed up SD model more, will more conv kernel be supported?
-
### Motivation and description
See here:
https://github.com/ggerganov/ggml/pull/254/files
I think we may need QuickGELU, for compatibility, if not same as GELU, more than just optimization.
…
-
Hello,
I am working on both image classification examples (CIFAR/IMAGENET) and am struggling understanding where the quantization appears in your examples. Actually, i looked in the prototxt files …
-
Currently, I got
|device| Mobilenet V4 Large| Mobilenet EdgeTPU|
|------|----:|---:|
|iPhone 13| 220.11 | 617.78|
|iPhone 14 Pro| 300.06 | 970.95|
|iPhone 15 Pro Max| 332.95 | 1145.05|
Ro…
-
Prior to filing: check that this should be a bug instead of a feature request. Everything supported, including the compatible versions of TensorFlow, is listed in the overview page of each technique. …
-
Hi,
I'm talking about this tutorial: https://coral.ai/docs/edgetpu/retrain-detection/#configure-your-own-training-data
There is no visible issue while doing the re-training, but in the end the r…