-
### 1. System information
Windows 11
### 2. Code
import tensorflow as tf
saved_model_dir = "C:/Users/s/Downloads/best (1)_saved_model"
converter = tf.lite.TFLiteConverter.from_saved_mod…
-
I deployed the BF16 and INT8 versions of Qwen2.5-coder-32b-instruct using vLLM (version 0.6.1) and evaluated them with OpenCompass. Surprisingly, BF16 underperformed compared to INT8 on several metric…
-
I use the following code to convert the internal state model into TFLite
```
converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.representative_dataset = representative_dataset_gen
conv…
-
### OpenVINO Version
2024.4.0
### Operating System
Other (Please specify in description)
### Device used for inference
CPU
### Framework
Keras (TensorFlow 2)
### Model used
ResNet50
### Issu…
-
### Before Asking
- [X] I have read the [README](https://github.com/meituan/YOLOv6/blob/main/README.md) carefully. 我已经仔细阅读了README上的操作指引。
- [X] I want to train my custom dataset, and I have read the …
-
Hello,
I am trying to run a pipeline containing a model with int8 input format, but it seems that the conversion uint8 -> int8 is not direct and a bit under optimized.
I can only get uint8 tenso…
-
### 1. System information
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Google Colab with Python 3.10.12
- TensorFlow installation (pip package or built from source):
pip package
-…
-
Hi, I get these warnings when running an int8 quantized model on I.MX 8M Plus using the vx delegate:
W [HandleLayoutInfer:332]Op 162: default layout inference pass.
W [HandleLayoutInfer:332]Op 56:…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### 请提出你的问题 Please ask your question
运行环境为：
Kylinv10 OS
Paddle 2.6.0
PaddleSlim 2.6.1
FT2000+ CPU
昆仑芯R200 XPU
原始模型为Pytorch导出的Resnet50转Paddle模型
PTQ代码如下：
```python
paddleslim.quant.quant_…
czp97 updated
2 weeks ago