-
As is the mediapipe tflite models can't be used by the Coral TPU because they're not fully quantized. I don't believe it's possible to do post-training integer quantization from an existing tflite mod…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
Hi. First of all, thank you for sharing your great work.
I am looking for a way to `fine-tune LLaMA-7B model` with SqueezeLLM.
It seems that the publicly available code in `llama.py` can only `benc…
-
### Describe the bug
This bug generates when I use torch.compile(model) in my code, which seems to raise an error in datasets lib.
### Steps to reproduce the bug
I use the following code to fine-tu…
-
Hi,
Rereading LLM-QAT paper, it appears to me that the results presented as RTN (post-training quantization, round to nearest) are inconsistent with LLM.int8() and SmoothQuant claims about outliers…
-
The official recommendation for the post-training quantization with accuracy control of OpenVINO models includes two methods: NNCF and Pot. I am wondering which one is better. It appears that the offi…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
MiniCPM-V-2自定义数据集微调时,数据集中如果有history,报错ValueError: Expected input batch_size (xxx) to match targ…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
Hi @fabawi , thanks for your work on this! I have been experimenting with imageBind for videos, I essentially extract the clips (5 secs), audio and subtitles from a video and I want them all in the sa…