-
## 🐛 Bug
When benchmarking model: 'Mixtral-8x7B-v0.1' we get OOM errors even with --checkpoint_activations True
The same configurations works for torch.compile.
Might be related to [https://gi…
-
### Run Information
Name | Value
-- | --
Architecture | x64
OS | Windows 10.0.22621
Queue | Pixel
Baseline | [b312812aa7abba8f8b82c6b0a70e912eb7ffe45d](https://github.com/dotnet/sdk/commit…
-
Ad documentation: Performance Benchmarks.
### Acceptance Criteria (mandatory to start implementation)
- [ ] Benchmarking metrics defined.
- [ ] Benchmarking code implemented.
- [ ] Results added to…
-
### Run Information
Name | Value
-- | --
Architecture | x64
OS | Windows 10.0.22631
Queue | ViperWindows
Baseline | [30b34e6d7b475c1de91623d3589723181a260523](https://github.com/dotnet/runtime/com…
-
Issue listing useful docker containers for large scale maintenance and experiment tasks:
* running `check_estimator` on all estimators or a subset thereof (e.g., specified by scitype). Runtime perf…
-
In meerkat-node, we have tests in the tests folder we need to add similar to meerkat-browser
You should follow these steps
1. Setup browser with puppeteer, you can refer - benchmarking/benchmarki…
-
# Bug report
### Bug description:
Building with --pgo on Windows seems to be broken on main (853b4b5).
My *hunch*, since this is failing in `ceval.c`, is that the recent [merge of the Tier 1 …
-
I wonder if this would make a difference in these benchmarks:
> If you are comparing multiple implementations of a piece of code you may want to benchmark them in separate invocations of Ruby so th…
-
# Benchmarking Your App with MetricKit • Andy Ibanez
[https://www.andyibanez.com/posts/benchmarking-app-metrickit/](https://www.andyibanez.com/posts/benchmarking-app-metrickit/)
-
**Describe the bug**
Current master depends on Infura to download some states and blocks for benchmarking. While this has worked fine before currently Infura timeouts for all requests. The pr…