-
Official gRPC implementations are benchmarked against a standard benchmarking suite.
https://grpc.io/docs/guides/benchmarking/
https://github.com/grpc/grpc/tree/master/src/proto/grpc/testing
…
-
**What would you like to be added/modified**:
Based on existing datasets, the issue aims to build a benchmark for domain-specific large models on KubeEdge-Ianvs. Namely, it aims to help all Edge AI a…
-
### 🚀 The feature, motivation and pitch
Include the Llama-405B model as part of the nightly performance benchmarks here: https://buildkite.com/vllm/performance-benchmark/builds/4068
Is the reaso…
-
Hi, Thank you for developing this amazing benchmark!
I created a virtual environment using anaconda and successfully installed crfm-helm (I followed the instructions from the official document [htt…
-
### System Info
I am working on the benchmarking suite in vLLM team, and now trying to run TensorRT-LLM for comparison. I am relying on this github repo (https://github.com/neuralmagic/tensorrt-demo)…
-
The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking
https://www.phoronix-test-suite.com/
-
### 🚀 The feature, motivation and pitch
The torchdynamo benchmarking scripts come with default batch size for each model based on A100 40GB GPU tests. When adapting these scripts for training on smal…
-
Firstly this is a great tool to have and I was pleased to find it!
## Issue
We are using this here https://github.com/CDCgov/Rt-without-renewal/issues/340 to help improve our code base and chas…
-
### Focus
In #624 Google benchmarking was added to the project. This epic tracks the expansion of this benchmark suite.
### Tasks
- [ ] #678 Benchmarking for Bragg calculation
### Other
- [x]…
-
There are 2 things we can do.
First, inline benchmarking within the algorithm so we can tell how much time it spends in processing each window.
Second, a separate benchmarking test suite to gauge th…