-
I see the example regarding centerpoint scn 3D backbone which includes fusion and QAT.
Does this library support the use of PTQ instead - and in case where can I look for an example?
-
Issue to track areas with missing tests that should be added.
- [ ] Handling of scaling_min_val combined with different restrictions on scale factors.
- [x] Calibration of activations scale factor…
-
within the docker (IMAGE: nvidia/cuda:12.1.0-devel-ubuntu22.04)
GPU: A100 40GB
TensorRT-LLM version: 0.10.0
flash-attn 2.5.9.post1
I quantize the phi3 model(phi-3-medium-128k-instrcut/), wi…
-
```
root@597e1d20794c:~/EOD# python -u -m up train --ng=1 --launch=pytorch --config=/root/EOD/configs/quant/det/faster_rcnn/faster_rcnn_r18_FPN_2x_quant_qdrop.yaml --display=10
NOTE! Installing ujs…
-
I used AIMET example of Tensoflow MobileNet quantization(using Examples/tensorflow/quantization/cle_bc.py). The accuracy of TOP1 and TOP5 is good, but the accuracy of quantization mode is bad.
The re…
-
# PTQ | Faster Coding With Vim
Bài viết dành cho những người chưa từng sử dụng vim! Động lực Nếu bạn gõ 10 ngón thì bàn phím như 1 cánh tay nối dài hay 1 phần cơ thể của bạn vậy. Lúc đó bạn chỉ tập t…
-
### Before Asking
- [X] I have read the [README](https://github.com/meituan/YOLOv6/blob/main/README.md) carefully. 我已经仔细阅读了README上的操作指引。
- [X] I want to train my custom dataset, and I have read …
-
Hello, is it possible to use the camera directly in the model to generate results in real time? Like yolo, you can input the camera data and get the result in real time.
-
为了方便测试,我参考作者的代码写了一个分类网络的ptq代码,然后在转onnx的时候对输出结果进行了对比,发现差异很大,不知道您这边有没有遇到过这个问题
复现步骤,使用cifar数据集,所以复现很快:
1. python fp32_train.py
2. python ptq.py(注意修改加载模型的路径)
[aa.zip](https://github.com/Susan19900…
-
I want to use qat method for my model, but i can only find ptq quantizer in executorch, are there some examples of how to implement Quantization Aware Training (QAT) for qnn backend?