-
Hi!
A few days ago, I read about `ntpd-rs` on [Hacker news](https://news.ycombinator.com/item?id=40778594) - thanks a lot for developing the project!
In the comments, I found several questions a…
-
The Benchmarks workflow failed on 2024-09-15 06:32 UTC
The most recent failing benchmark was on macos-latest py3.9 Qt
with commit: 4385a20a1439358d016d76a9a38c210066f0826e
Full run: https://github.c…
-
**Describe the feature:**
Currently the way we get Score and Evaluation on Benchmark is by iterating over every benchmark and get their stats and clusters. While this works for now, in the future we …
-
Hi!
As I have done many times before, I decided to test the Profile-Guided Optimization (PGO) technique to optimize the library performance. For reference, results for other projects are available …
-
Add criterion benchmarks for common uses of library (signing a transaction, using TransactionBuilder, etc). Also add criterion benchmarks for some interpreter methods (mostly Coll methods since they'r…
-
```
hyperfine "uv pip compile scripts/requirements/airflow.in --exclude-newer 2024-06-20" "uv pip compile scripts/requirements/airflow.in --exclude-newer 2024-08-08"
Benchmark 1: uv pip compile scr…
-
We should have benchmark folder where we add all benchmarking models that work on real-world datasets. For those models we want to track end-to-end performance and evaluation score. Also, we want to a…
-
Benchmark mandelbrot
My LuaJIT BF Engine runs it in 1.870 secs
https://github.com/ExtReMLapin/fast_brainfuck.lua/blob/main/torture%20test/mandel.b
-
Hi, I am performing benchmark on aarch64 instance,
Instance: AWS EC2 Graviton(aarch64)
OS: Amazon Linux 2023
Python: 3.11
Benchmark command:
```shell
python3 -m run --engines qdrant-sq-rps-m-…
-
I noticed that GPT2Tokenizer is used when evaluating GPT2, which doesn't have a mask_token. Will this impact the evaluation result?
I think I should add a new one manually but I'm unsure which one I…