-
```
from transformers import Qwen2VLForConditionalGeneration, AutoTokenizer, AutoProcessor, AutoConfig
from qwen_vl_utils import process_vision_info
import torch
model_name = "Qwen/Qwen2-VL-7B-I…
-
**Describe the bug**
The example from the readme file for model quantization doesn't work.
Location: https://github.com/microsoft/onnxruntime/tree/master/onnxruntime/python/tools/quantization/E2E_ex…
-
Hi,
I'm using your repo to run inference on live camera stream with YoloV5 (Jetson Nano - DeepStream-6).
The engine work well using FP32 or FP16.
However, I'm trying to convert the model with in…
-
### The bug
Immich recognized about 200 photos from *completely* different things, people, landscapes, foods, game screenshots (completely unrelated photos) as being one person in face recognition. S…
-
Hello,
I have tried to make my model comaptible with QAT, according to your guideline.
I started with defining a QuantizeConfig class:
```
LastValueQuantizer = tfmot.quantization.keras.quantizers…
-
Here is my understanding of the existing state of things and what I think we should be doing to make our lower-bit kernels more performant at both small and larger batch sizes. I'm making this an RFC …
-
I've noticed that images produced with hitherdither are slightly different than those produced with other programs using the same algorithms.
I tested this using Floyd-Steinberg on a solid 50% gray…
-
When I try to convert a custom model to tflite model, I am getting all nan
```
[{'name': 'input_1', 'index': 0, 'shape': array([ 1, 416, 416, 3], dtype=int32), 'shape_signature': array([ -1, 41…
-
Runtime error on SDF following `conda env create --file environment.yml`
(xfel) [yoon82@sdf-login01 XFELPoseGAN]$ python main.py config_path configs/xfel_splice_simulated_poses_supervised_multires.…
-
### Discussed in https://github.com/openvinotoolkit/nncf/discussions/2547
Originally posted by **MinGiSa** March 5, 2024
I've been working on converting Torch models into OpenVINO models rece…