github-actions[bot]
commented
5 months ago Benchmark Results
| master | 86c3ded4f56082... | master/86c3ded4f56082... | |
|---|---|---|---|
| logpdf/("SequentialSamplingModels.DDM", 10) | 1.67 ± 0.11 μs | 1.66 ± 0.12 μs | 1 |
| logpdf/("SequentialSamplingModels.DDM", 100) | 17.3 ± 1.3 μs | 17.3 ± 1.3 μs | 1 |
| logpdf/("SequentialSamplingModels.LBA", 10) | 2.17 ± 0.15 μs | 2.16 ± 0.15 μs | 1 |
| logpdf/("SequentialSamplingModels.LBA", 100) | 20.5 ± 0.55 μs | 20.5 ± 0.52 μs | 1 |
| logpdf/("SequentialSamplingModels.LNR", 10) | 0.962 ± 0.16 μs | 0.964 ± 0.16 μs | 0.998 |
| logpdf/("SequentialSamplingModels.LNR", 100) | 8.22 ± 0.25 μs | 8.21 ± 0.23 μs | 1 |
| logpdf/("SequentialSamplingModels.RDM", 10) | 2.27 ± 0.12 μs | 2.28 ± 0.14 μs | 0.999 |
| logpdf/("SequentialSamplingModels.RDM", 100) | 21.8 ± 0.48 μs | 21.8 ± 0.45 μs | 1 |
| logpdf/("SequentialSamplingModels.Wald", 10) | 0.23 ± 0.16 μs | 0.231 ± 0.16 μs | 0.996 |
| logpdf/("SequentialSamplingModels.Wald", 100) | 2.06 ± 0.17 μs | 2.09 ± 0.16 μs | 0.988 |
| logpdf/("SequentialSamplingModels.WaldMixture", 10) | 0.923 ± 0.16 μs | 0.92 ± 0.16 μs | 1 |
| logpdf/("SequentialSamplingModels.WaldMixture", 100) | 8.92 ± 0.16 μs | 8.92 ± 0.16 μs | 1 |
| rand/("SequentialSamplingModels.DDM", 10) | 3.94 ± 0.55 μs | 3.95 ± 0.59 μs | 0.998 |
| rand/("SequentialSamplingModels.DDM", 100) | 0.0384 ± 0.0019 ms | 0.0383 ± 0.0019 ms | 1 |
| rand/("SequentialSamplingModels.LBA", 10) | 3.24 ± 1.2 μs | 3.23 ± 1.3 μs | 1 |
| rand/("SequentialSamplingModels.LBA", 100) | 16.6 ± 0.57 μs | 16.8 ± 0.75 μs | 0.988 |
| rand/("SequentialSamplingModels.LCA", 10) | 0.769 ± 0.28 ms | 0.763 ± 0.28 ms | 1.01 |
| rand/("SequentialSamplingModels.LCA", 100) | 8.35 ± 0.28 ms | 8.28 ± 0.22 ms | 1.01 |
| rand/("SequentialSamplingModels.LNR", 10) | 1.07 ± 0.19 μs | 1.07 ± 0.19 μs | 1 |
| rand/("SequentialSamplingModels.LNR", 100) | 7.48 ± 3.8 μs | 7.78 ± 3.7 μs | 0.962 |
| rand/("SequentialSamplingModels.RDM", 10) | 1.35 ± 0.19 μs | 1.33 ± 0.19 μs | 1.01 |
| rand/("SequentialSamplingModels.RDM", 100) | 11.2 ± 3.8 μs | 11.1 ± 3.6 μs | 1.01 |
| rand/("SequentialSamplingModels.Wald", 10) | 0.463 ± 0.17 μs | 0.464 ± 0.16 μs | 0.999 |
| rand/("SequentialSamplingModels.Wald", 100) | 2.97 ± 0.52 μs | 2.88 ± 0.2 μs | 1.03 |
| rand/("SequentialSamplingModels.WaldMixture", 10) | 1.18 ± 0.14 μs | 1.18 ± 0.16 μs | 1 |
| rand/("SequentialSamplingModels.WaldMixture", 100) | 11.3 ± 0.2 μs | 11.3 ± 0.19 μs | 1 |
| simulate/SequentialSamplingModels.DDM | 3.79 ± 1.5 μs | 3.75 ± 1.5 μs | 1.01 |
| simulate/SequentialSamplingModels.LBA | 3.63 ± 0.48 μs | 3.72 ± 0.36 μs | 0.978 |
| simulate/SequentialSamplingModels.LCA | 0.114 ± 0.052 ms | 0.108 ± 0.032 ms | 1.06 |
| simulate/SequentialSamplingModels.RDM | 0.1 ± 0.03 ms | 0.102 ± 0.033 ms | 0.985 |
| simulate/SequentialSamplingModels.Wald | 9.16 ± 4.6 μs | 9.23 ± 4.7 μs | 0.992 |
| simulate/SequentialSamplingModels.WaldMixture | 4.1 ± 1.5 μs | 4.06 ± 1.6 μs | 1.01 |
| time_to_load | 3.77 ± 0.034 s | 3.74 ± 0.026 s | 1.01 |
Benchmark Plots
A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR. Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).
This pull request changes the compat entry for the
Turingpackage from0.29.0,0.30.0,0.31.0,0.32to0.29.0,0.30.0,0.31.0,0.32, 0.33. This keeps the compat entries for earlier versions.Note: I have not tested your package with this new compat entry. It is your responsibility to make sure that your package tests pass before you merge this pull request.