-
### 🐛 Describe the bug
Traceback (most recent call last):
File "anaconda3/envs/et_qnn/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
…
-
I am trying to load the [meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8) model, but I am encountering issues with the o…
l-bat updated
2 weeks ago
-
Hi everyone,
Has anyone successfully created a .pte of llama 3.2 1B instruct spinquant from https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8/tree/main
Asking because I…
-
### 🐛 Describe the bug
```
https://pytorch.org/executorch/stable/apple-runtime.html
./build/build_apple_frameworks.sh --coreml --custom --mps --optimized --portable --quantized --xnnpack
```
…
-
Dear @shewu-quic, @cccclai, ..please mention anyone relevant
Could you share the command used to create the R matrix for generating the Llama-3.2-3B & 1B SpinQuant-INT4-E08 .pth files you've releas…
-
Dear @cccclai
I’m reviewing the code while following the [guide](https://github.com/pytorch/executorch/blob/main/examples/demo-apps/android/LlamaDemo/docs/delegates/qualcomm_README.md)(Export with…
-
### System Info
Windows 11
Python 3.12.7 (and 3.12.5 apparently depending on running py --version or python --version from PowerShell)
### Information
- [X] The official example scripts
…
-
### 🐛 Describe the bug
Run following command to build for x64 on arm64 mac:
```console
cmake . -B out \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_PREFIX_PATH=/opt/homebrew/Caskroom/miniconda/base/en…
-
SpinQuant is a subsequent work to QuaRot. However, we have noticed that the definitions of the rotation matrix pairing details differ between the two papers. In QuaRot, first, there is an online Hadam…
-
Hi,
Thanks very much for your work and for publishing your code. I am currently working on integration of SpinQuant into [torch/ao](https://github.com/pytorch/ao/pull/983/), and I would like to cla…