-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussi…
-
### Describe the issue
![image](https://github.com/microsoft/onnxruntime/assets/43288861/243d39f4-a1f3-4829-98b9-fa99cf4fe968)
How to use the int8 model. It's like CPU_FP8 or GPU_FP8?
### To reprod…
-
according to the manual, i just wanna speed up inference on the CPU via OpenVINO, however got the problem as bellow.
(openvino_conv_env) [root@zaozhuang3L-C6-35 whisper.cpp]# ./main -m models/ggml-ba…
-
I'm currently compiling Openvino on Ubuntu 22.04
I've just downloaded the whisper transcription model, and its a massive 16GB !
The expanded size of the whisper.cpp=ovenvino-models is an incredibl…
-
###
I compiled the vllm0.5.4 using the CPU, which does not support AVX512. After compiling, I entered the container and executed the command to start the llama3-8b model.
```text
python3 -m…
-
### Request Description
I am using openvino with yolov8.
There is a way to select classes to detect before innfer?
### Feature Use Case
_No response_
### Issue submission checklist
- …
-
### 🚀 Feature request
Quantization is a widely used technique to accelerate models, particularly when using the [torch.compile](https://pytorch.org/tutorials/intermediate/torch_compile_tutorial.htm…
-
### OpenVINO Version
2024.01/2024.1.0
### Operating System
Windows System
### Hardware Architecture
x86 (64 bits)
### Target Platform
_No response_
### Build issue description
…
-
### Context
Some models require preprocessing done to the data before inference. Usually it's done with packages like `numpy` or `pillow` for images, but it adds dependencies and additional steps to …
-
When upgrading from OTX 1.6 to 2.X I noticed the mean_values and scale_values seemed to have moved from the XML file from the "conversion_parameters" to "model_info".
Am I right and thinking this m…
j99ca updated
3 hours ago