-
### System Info / 系統信息
ubuntu 22.0
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚本
- [ ] My own modified scripts / 我自己修改的脚本和任务
### Reproduction / 复现过程
python gradio_web_demo.p…
-
### 🚀 The feature, motivation and pitch
Hi,
I have
- provisioned vm with A100
- installed needed driver.
- downloaded Llama 3.1 8B Instruct model
- llama build, configure & run (using meta-ref…
-
### System Info
**Platform:** Dell 760xa with 4x L40S GPUs
**OS Description:** Ubuntu 22.04.5 LTS
**GPU:** NVIDIA-SMI 550.90.07 Driver Version: 550.90.07 CUDA Version: 12.4
*…
-
### OpenVINO Version
Name: openvino
Version: 2024.4.0
Summary: OpenVINO(TM) Runtime
Home-page: https://docs.openvino.ai/2023.0/index.html
Author: Intel(R) Corporation
Author-email: openvino@in…
-
### Describe the issue
Hello, I am interested in using v1.20.0 on openvino hardware as the new version claims to have optimized first inference latency. It seems that v1.20.0 has been released for [o…
-
# Bug Report
### Is the issue related to model conversion?
No
### Describe the bug
My graph consists of a Concat node (with Axis=0) with two inputs with initializers. The first is initialized …
-
### 🔎 Search Terms
generic function spread regression inference
### 🕗 Version & Regression Information
- This is the behavior in every version I tried, and I reviewed the FAQ for entries about gene…
-
### Describe the issue
### Description:
I am observing high memory spikes after each run of the inference session when passing the previous outputs of the inference to the input of another iteration …
-
### System Info
WSL2
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### 🐛 Describe the bug
Running Llama3.2-3B-Instruct and get the error `ValueError: Llama3.1-8…
-
## Description
Platform containers reach 100% CPU usage and become unresponsive.
Causes liveness probe to fail and restarts.
## Environment
1. OS (where OpenCTI server runs): Ubuntu 22.04 LT…