-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
Other
### Bug
I am int…
-
rknn-toolkit version: 1.7.5
--> Config model
Traceback (most recent call last):
File "onnx2rknn_demo_ZQ.py", line 224, in
outputs = export_rknn_inference(input_img)
File "onnx2rknn_dem…
-
/kind feature
**Describe the solution you'd like**
Hope add [https://github.com/xorbitsai/inference](https://github.com/xorbitsai/inference) as the kserve huggingface LLMs serving runtime
Xor…
-
### Describe the issue
Hi,
I have been reading the documentation for ONNX Runtime and came across the RKNPU Execution Provider (EP). I would like to clarify my understanding:
It appears that the …
-
Hi,
Thank you for the excellent project! I have a question: is it possible to use the online inference model with your pipeline?
Thanks in advance!
-
### OS Platform and Distribution
Linux Ubuntu 22.04
### Compiler version
_No response_
### Programming Language and version
Bazel
### Installed using virtualenv? pip? Conda?(if python)
_No resp…
-
### 🚀 The feature, motivation and pitch
We have a need for vLLM to support CPU inferencing for the PowerPC architecture. This project should start thinking about non-x86 platforms.
[Initial Power…
-
### OpenVINO Version
2024.1
### Operating System
Ubuntu 22.04 (LTS)
### Device used for inference
CPU
### OpenVINO installation
PyPi
### Programming Language
Python
### H…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
- update the timeout keyword in database schema of platform api and then consume the latest schema in here to reflect the updated term i.e concurrency
**Note** before making this change we might need…