-
Benchmark functions can call Log, Error and Fatal, but if the benchmark is run with the Benchmark function, all messages are discarded.
https://play.golang.org/p/fd5Ed-il70V
Perhaps the messages…
-
**Describe the bug**
This looks like a continuation of #164
**To Reproduce**
This may still need to be entirely fixed. I can reproduce this about once every 50-100 runs or so. Using https://git…
sean- updated
1 month ago
-
Hello again! I am a maintainer of [pubgrub-rs](https://github.com/pubgrub-rs/pubgrub), which is a different dependency resolution algorithm written in Rust. It would be lovely if our projects found wa…
-
I will create a benchmark as tested method, for now, probably 3--5 methods with nontrivial CFG and method call chain.
Then, @lylytran may help to check the features of current Ziyuan project and co…
-
We should have a GitHub action that runs `make test` on each commit and pull request to main.
-
I originally thought this was a dotnet runtime issue but a single file executable basic console app is quicker on all runtimes than invoking dotnet run.
However once you add the Microsoft.Testing.P…
-
**Title:** Discrepancy and Variance in Benchmark Results for O1-mini and GPT-4o-mini Models
**Description:**
Hi LiveBench Team,
I am reaching out to discuss some discrepancies and variance in…
-
### 🐛 Describe the bug
It's annoying to have to always pass PYTHONPATH. If we put the benchmark harness somewhere in torch/_testing this would no longer be necessary. But maybe that would make backte…
-
Firstly, I want to say I’ve really enjoyed using this library, so I decided to explore its performance under load.
To do this, I ran a benchmark comparing a few straightforward optimization strateg…
-
We should also invest some time in benchmarking this a bit to have some idea around how big a backend cluster needs to be for a certain amount of users or messages https://socket.io/docs/v4/load-testi…