-
https://github.com/likyoo/open-cd/blob/main/docs/inference.md
When I try to test the inference with existing models, I encouter the following problems.
I want to know how to resovle this problem. …
-
/kind feature
**Describe the solution you'd like**
At the moment, Inference Services can specify a single Inference Logger with
```yaml
apiVersion: serving.kserve.io/v1beta1
kind: InferenceSe…
-
Explore making using tensorflow lite on Android easier.
-
## ❓ Questions and Help
When I made multiprocess inference of huggingface transformers frame, I used xmp.spawn(perform_inference, args=(args,), nprocs=4), and I wanted to run 4 scripts once. However,…
-
Hi @Narsil or anyone who can help me. I have got a problem with the api inference of my model called GeoBERT (https://huggingface.co/botryan96/GeoBERT).
It always says "Overloaded" or sometimes "In…
-
### System Info
TEI Inference Docker 1.4 , Cuda 12.2 , Nvidia T4
sudo docker run --gpus all -p 8080:80 -v ./volume2:/data --restart always -d ghcr.io/huggingface/text-embeddings-inference:turing-1…
-
Is there a tool that can **inspect** dla standalone loadable file, i want to get inner nodes/layers info ?
I use trtexec load dla loadble file wrong as follow:
```
[09/04/2024-13:51:41] [I] En…
-
### Description
When interacting with ELSER in serverless locally it crashes when attempting to perform inference.
Steps to reproduce
- Ensure docker is setup and running
1. Checkout kibana …
-
In addition to openai, i would like to add the ability to call a model via [huggingface inference API](https://huggingface.co/docs/api-inference/quicktour)
This would allow the deployer to select f…
-
### OpenVINO Version
2021.2.1.0
### Operating System
Windows System
### Device used for inference
CPU
### OpenVINO installation
Build from source
### Programming Language
C++
### Hardware Ar…