-
## ❓ Questions and Help
When I made multiprocess inference of huggingface transformers frame, I used xmp.spawn(perform_inference, args=(args,), nprocs=4), and I wanted to run 4 scripts once. However,…
-
### Checklist
- [ ] I have searched related issues but cannot get the expected help.
- [ ] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/tree/main/docs/en/faq.md) but …
-
**Abstract**
Individual frameworks such as uTensor and TFLM have their own sets of on-device APIs. In some cases, significant boilerplate code and framework-specific knowledge are required to impleme…
-
### Description
When interacting with ELSER in serverless locally it crashes when attempting to perform inference.
Steps to reproduce
- Ensure docker is setup and running
1. Checkout kibana …
-
Hi @longcw,
I am trying to use your model in a custom system to do inference on new frames against a gallery of images already seen. I'm having a little bit of trouble deciphering your code and its…
-
**Feature request**
To add more customizable models with different initializers, it would be very useful to access initializers and modify them when creating the object. This would only require to ex…
-
![image](https://github.com/user-attachments/assets/9686e584-0af5-447a-88d1-b27bff5262e8)
---------------------------------------------------------------------------
ModelError …
-
### Describe the issue
When using SetIntraOpNumThreads (1) and SetIntraOpNumThreads (10) on GPU, their inference time is similar, both around 30ms。I have already done warm-up before calculating the…
-
Will require some core changes to how distributed inference works, hence higher bounty of $500.
This would be a great contribution to exo.
-
### OpenVINO Version
openvino : 2024.3.0
### Operating System
Windows System
### Device used for inference
iGPU
### OpenVINO installation
PyPi
### Programming Language
Python
### Hardware Ar…