-
### System Info
tgi-gaudi docker container built from master branch (4fe871ffaaa62f1a203607078e868fcca962b017)
Ubuntu 22.04.3 LTS
Gaudi2
HL-SMI Version: hl-1.15.0-fw-48.2.1.1
Driver Version: 1…
-
### Question
Great work! Your research is very impressive and I've been using it for tiny object detection with great results -- there are many fewer false positives.
However, I'm struggling with …
-
Hello everyone.
I have been using MLperf benchmarks for some time. And I have a small list of questions about them. I am asking them here because I have not found answers in other sources of informat…
-
1. mainly follow what the main Inference group have and replace SD XL with 1.5
2. we don't have 1.5 keras or tflite, we can start with 1.4 tflite files (1.5 and 1.4 have the same architecture, just d…
-
Dear sir,
I am trying to use your repository to examine the performance of the tracking inference. However, when I followed your instructions to run python scripts/benchmark/yolov8/botsort/test.py --…
-
### Search before asking
- [X] I have searched the Inference [issues](https://github.com/roboflow/inference/issues) and found no similar bug report.
### Bug
If you install `inference-gpu` on a mac…
-
http://127.0.0.1:8000/krai_qaic_task/benchmark/run_benchmarking
-
http://127.0.0.1:8000/tmp/benchmark/run_benchmarking/
QAIC
-
### 🐛 Describe the bug
At main - `python benchmarks/dynamo/timm_models.py --performance --cold-start-latency --inference --bfloat16 --backend inductor --disable-cudagraphs --device cuda --only=pnasne…
-
We're exploring various optimizations available in the [Diffusers library](https://huggingface.co/docs/diffusers/main/en/optimization/opt_overview) to enhance VRAM usage and inference speed. @titan-no…