-
### Issue type
Support
### Have you reproduced the bug with TensorFlow Nightly?
Yes
### Source
source
### TensorFlow version
2.13
### Custom code
Yes
### OS platform and distribution
_No re…
-
I'll appreciate it if y could provide an easy inference API for extra tests.
-
### System Info
TEI Inference Docker 1.4 , Cuda 12.2 , Nvidia T4
sudo docker run --gpus all -p 8080:80 -v ./volume2:/data --restart always -d ghcr.io/huggingface/text-embeddings-inference:turing-1…
-
### Description of the bug:
I converted [tiny-llama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) model using the [convert_to_tflite.py](https://github.com/google-ai-edge/ai-edge-to…
-
/kind feature
**Describe the solution you'd like**
At the moment, Inference Services can specify a single Inference Logger with
```yaml
apiVersion: serving.kserve.io/v1beta1
kind: InferenceSe…
-
For now I am doing inference on images following the code in the inference.ipynb file. However, I have realised that it uses image paths to be able to make the inference.
However, due to limitatio…
-
**Kibana version:** 8.14.0-SNAPSHOT
**Elasticsearch version:** 8.14.0-SNAPSHOT
**Server OS version:** OSX 14.3
**Original install method (e.g. download page, yum, from source, etc.):** sour…
-
Is there a batch inference API available? In our use case, we need to perform inference on several (up to 100+) cropped parts of an image. A batch inference API would make this operation efficient. Th…
-
Phone model: xiaomi14pro
Memory: 16GB
After downloading the llama3 8B model, a CLANG compilation error was reported during loading. The specific logs are as follows:
Traceback (most recent call l…
-
**Describe the rule you'd like to see added and to what rule set**
I'd like to see [`always_declare_return_types`](https://dart.dev/tools/linter-rules/always_declare_return_types) included in the r…