-
When I use aimet autoquant to quant my model, I met the following issues:
- Prepare Model
Traceback (most recent call last):
File "/workspace/aimet/build/staging/universal/lib/python/aimet_torch/…
-
Hi!
Thank you for the paper! It is inspiring that you can compress weights to about 1 bit and the model still works better than random.
A practical sub-2-bit quantization algorithm would be a grea…
-
The following problem is solved almost instantaneously in both SageMath and Matlab, but it takes much longer in sympy. The problem has 8 solutions. If I use `manual=True`, solve is very fast, but it f…
-
### System Info
- GPU:L40S
- Tensorrt-llm:0.11.0.dev2024060400
- cuda:cuda_12.4.r12.4/compiler.34097967_0
- driver:535.129.03
- os:DISTRIB_DESCRIPTION="Ubuntu 22.04.4 LTS"(docker)
-
### Who…
-
### Checklist
- I have searched related issues but cannot get the expected help.
- I have read related documents and don't know what to do.
### Describe the question you meet
\[here\]
###…
-
Very appreciate having such a good job. I want to report a bug for cmd_sensitive_analysis in qat.py
When calling the **quantize.calibrate_model** function, a `device` parameter is underwritten, ca…
-
When performing Resnet18 PTQ using TRT-modelopt, I encountered the following issue when compiling the model with TRT.
First off, I started with a pretrained resnet18 from torchvision. I replaced t…
-
### Before Asking
- [X] I have read the [README](https://github.com/meituan/YOLOv6/blob/main/README.md) carefully. 我已经仔细阅读了README上的操作指引。
- [X] I want to train my custom dataset, and I have read the …
-
Add one example to repo and DLM
-
I want to apply this algorithm to a Jetson AGX Orin development board.
However, many difficulties were encountered, such as failed installation of libraries such as mmcv and mmdet. Pyquaternion inst…