-
Hey @sanchit-gandhi, like the repo. Excited to see this being worked on. Here's a benchmark of WhisperSpeech. I used your sample script on the same exact text snippet and it finished processing in …
-
i have run the command "python -m torch.distributed.launch --nproc_per_node=1 test_net.py ". In the config file, i used the download “model_finetune.pth” and test it on icdar_test dataset. The outpu…
-
A hypothetical benchmark spec would benchmark "tests" and report timing information, allowing configuration using aspects like `@@ warmup(50) @@ parallelism(5) @@ iterations(1000)`.
TODO: Spec this…
-
https://github.com/JuliaGraphics/Colors.jl/issues/496 highlighted some bizarre behavior whose underlying cause is not understood. A partial investigation by several contributors to both these packages…
-
hi there, I am using a 8Gen3(Xiaomi14 Pro 68GB/s bw) and following the Android Cross Compilation Guidance Option.1: Use Prebuilt Kernels guide to test llama-2-7b-4bit token generation performance.
it…
-
### 🐛 Describe the bug
torchbench_amp_bf16_inference
- [ ] `sam_fast`
Traceback (most recent call last):
File "/home/sdp/actions-runner/_work/torch-xpu-ops/pytorch/benchmarks/dynamo/common.p…
-
o, I have now 4 solid test scenarios thanks to everyone's help here. The have all been tested in cpu mode. I am now switching to nvidia and the docker container doesn't seem to build.
I will be t…
-
### System Info
```shell
Optimum - latest from github
Python - 3.8
platform NVidia V100
```
### Who can help?
@JingyaHuang
### Information
- [X] The official example scripts
- […
-
### 🚀 The feature
## Author: Li Ning
## Background
A stateful model possesses the ability to detect interdependencies between successive inference requests. This type of model maintains a persist…
-
Hi! I recently changed the video cards on my test bench. When trying to run familiar tests, I encountered errors.
I entered: cm run script --tags=run-mlperf,inference,_find-performance,,_full_r4.1-…