-
-
A major constraint of single-node computation is the amount of available memory.
It would be nice to see the same benchmarks against competing tools as memory pressure line charts over time.
Giv…
-
As there is custom-data for the data field https://eigenledger.gitbook.io/empyrial/using-custom-data
like this, is there something for custom-benchmark for benchmark field ?
-
Add `piko bench` tooling to benchmark a Piko cluster. This can use `piko test` to add 'fake' upstreams that echo the request.
Such as benchmarking HTTP requests should support specifying the number…
-
**Describe the bug**
The IR benchmark for [DecoderMux](https://github.com/google/xls/blob/cd901120adfa5355b5ea40adcd97bfc61af2f3c7/xls/modules/zstd/dec_mux.x) proc is prone to a random failure after i…
-
Hey,
Are there any benchmarks you are running? I implemented an allocator that tries to be efficent for cases like arrow computation and would like to test your benchmarks with my allocator vs othe…
-
-
- If model name contains mamba, use MambaForCausalLM. https://huggingface.co/state-spaces/mamba-2.8b-hf
- Return seconds per question
- return GPU memory usage, use `torch.cuda.max_memory_allocated…
-
In the file `unibench/benchmarks_zoo/benchmarks.py`, it seems like `dspr_y_position` is defined as `transfer` while it's marked as `vtab` in the associated README in `unibench/benchmarks_zoo/README.md…
-
Hi!Thank you so much for developing and maintaining a great tool.
Can you tell me how to obtain input files in benchmark testing?
For example,“/staging/leuven/stg_00002/lcb/cbravo/Multiomics_pipelin…