-
The latency i am getting here and the actual time when i am inferencing are not same. And also there is a huge difference between these two. So could be the problem?
-
With the [switch away from Fairseq to huggingface transformers](https://github.com/UKPLab/EasyNMT/commit/9b69703af901a7aeb83b5dda0830123a91c307ab) in EasyNMT 2.0, there seem to have been substantial c…
-
## ❓ Questions and Help
Here's my system: docker image with gpu support ubuntu 18.04
```
(base) root@43a59b70d445:/app/scene-graph-benchmark# nvidia-smi
Thu Sep 21 11:57:45 2023
+-------…
-
Hi, thanks for your excellent work!
I'm quite interested in your approach to speedup ViT's throughput. However, when I implement ViT-B end-to-end inference (including data Input, preprocessing, and …
-
Hi, thank you for the impressive work from your team. I have learned a lot. When I am running the code for run_patch and run_wsi, I always encounter an error at this location: "/project/DPDS/Xiao_lab/…
-
Hello
The purpose of this issue to add an sdl/container for running benchmarks for pytorch with [torchbench](https://github.com/pytorch/benchmark/tree/main) on gpu providers.
I have written an…
-
### System Info
GPU A30 * 2
TensorRT-LLM version: v0.9.0
Model: vicuna 13B
### Who can help?
@byshiue
### Information
- [X] The official example scripts
- [ ] My own modified scripts
#…
-
I'm trying to executed this benchmark: https://github.com/mlcommons/inference_results_v1.0/tree/master/closed/Intel/code/resnet50/tensorflow but when running it I have an error like:
```
2022-02-01 …
-
https://github.com/LAION-AI/CLIP_benchmark/blob/main/clip_benchmark/metrics/zeroshot_classification.py#L44
-
The command I use:
make calibrate RUN_ARGS="--benchmarks=resnet"
The output:
[2020-05-20 01:03:19,521 main.py:291 INFO] Using config files: measurements/Xavier/resnet/SingleStream/config.json,…