-
https://codspeed.io.
I'd be interested to see bottlenecks and would probably contribute speed-optimization PRs.
-
We are in the process of updating our benchmark code and adding benchmarks on the ImageNet dataset. The goal of this issue is to coordinate and track progress of the update.
The new benchmark code …
-
### Problem
CodSpeed is good, but has some anomalies.
In particular:
1. All system calls (e.g. system allocator) are "free" on Codspeed's measures.
2. They say [it doesn't take into account …
-
Hi there!
Thank you for creating and maintaining this benchmark. I am writing my own databind library and these benchmarks are just so great to have. I can plop in my own library within a couple of…
-
I regularly see 10% swings in performance. Typically if I run the benches 3 times, I'll see a spread of at least 10%.
Is anyone else seeing this? I haven't yet figured out why, but it renders the b…
-
The training benchmark link no longer works : https://huggingface.co/blog/huggingface-and-optimum-amd
How can one test training throughput on AMD these days?
Also, can you provide details about th…
-
We should add benchmarks to this repo.
- `jni/benchmark` and `jnigen/benchmark`
- Use https://pub.dev/packages/benchmark_harness
- You can see some examples https://github.com/dart-lang/sdk/tr…
-
The ongoing effort of optimizing sp1 cycles:
https://github.com/CeciliaZ030/block-cycles/tree/master
## Latest results
Before Txs
```
[2m2024-06-04T10:42:40.092527Z[0m [34mDEBUG[0m [1mexecut…
-
### 🚀 The feature, motivation and pitch
I would like to benchmark google's Gemeni models trough their API on scandinavic languages.
(Or preferably, benchmark any model trough any API that fits a st…
-
We should add benchmarks for invariants, so we have clear data on how to improve them. See [https://github.com/foundry-rs/foundry/issues/4433](https://github.com/foundry-rs/foundry/issues/4433) for mo…