Bodigrim tasty-bench issues

Bodigrim / tasty-bench

Featherlight benchmark framework, drop-in replacement for criterion and gauge.

https://hackage.haskell.org/package/tasty-bench

MIT License

80 stars 11 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

averaging over several random inputs

#61 MangoIV opened 10 hours ago
5
Subtract out gc time?

#60 DaveBarton opened 1 month ago
4
WithLoHi (Estimate {estMean = Measurement {measTime = 41529118775, measAllocs = 0, measCopied = 0, measMaxMem = 0}, estStdev = 1595055320}) (-Infinity) Infinity

#59 kindaro closed 2 months ago
2
Add Eq, Ord, Show, Num instances where appropriate

#58 Bodigrim closed 2 months ago
1
How to avoid excessive GC

#56 wismill closed 3 months ago
3
Some benchmarks written for `criterion` just complete immediately with `tasty-bench`.

#54 klapaucius closed 5 months ago
2
Print more digits?

#53 mitchellwrosen closed 6 months ago
6
Unhandled resource exception on pure IO action

#52 bolt12 closed 10 months ago
6
Subtract benchmark baseline

#50 1Jajen1 closed 1 year ago
6
How to remove "All" from every entry

#49 ribosomerocker closed 1 year ago
6
Excessive inlining may optimize away the function to benchmark

#48 wismill closed 6 months ago
14
Consider benchmarking until GCStats stabilise when given +RTS -T

#47 Bodigrim closed 1 year ago
1
Benchmarks sometimes get stuck

#46 konsumlamm closed 1 year ago
3
Bump CI to GHC 9.6.1 (release) and 9.2.7

#45 andreasabel closed 1 year ago
1
Recommend mitigations for benchmark instability introduced by GHCs SpecConstr.

#44 AndreasPK closed 1 year ago
5
Allow running benchmarks a given number of times.

#43 AndreasPK closed 1 year ago
8
Custom, ad-hoc metrics?

#42 dan-blank closed 1 year ago
4
Output of the benchmark function is retained in memory

#39 noughtmare closed 6 months ago
11
Estimate standard deviation for memory statistics

#38 brprice closed 1 year ago
2
Benchmarking a memoized function

#37 dschrempf closed 1 year ago
2
CSV reporter doesn't show baseline comparison

#36 hasufell closed 1 year ago
5
Even less dependencies?

#35 hasufell closed 1 year ago
8
Think about benchmarking of linear and unlifted data

#34 Bodigrim closed 1 year ago
1
Allow to measure wall-clock time

#33 amesgen closed 2 years ago
2
Fix #31, fix #28: correct verbalization of slowdown/speed up

#32 andreasabel closed 2 years ago
4
Misleadling verbalization of speed up / slow down

#31 andreasabel closed 2 years ago
4
Graceful degradation for Windows without chcp 65001

#30 Bodigrim closed 2 years ago
0
Print ack message when execution time is same as baseline

#29 santiweight closed 2 years ago
2
When running benchmarks against a baseline, it is unclear whether the baseline was compared against

#28 santiweight closed 2 years ago
1
Add lazyness related comment to funcToBench impl

#27 phadej closed 2 years ago
1
Add bench-fibo example as proper benchmark

#26 phadej closed 2 years ago
2
A flag to run each benchmark exactly *n* times

#25 ocharles closed 2 years ago
2
Provide module names on linked identifiers

#24 tomjaguarpaw closed 2 years ago
3
Add a switch to measure wall clock time

#23 Bodigrim closed 2 years ago
4
Add ability to fail when bcompare is higher than expected

#22 Bodigrim closed 2 years ago
0
Add debug mode

#21 harendra-kumar closed 2 years ago
5
Report RTSStats.max_mem_in_use_bytes

#20 harendra-kumar closed 3 years ago
4
Spurious allocations reported with --csv option

#19 harendra-kumar closed 3 years ago
7
Unable to match pattern

#18 harendra-kumar closed 3 years ago
12
Do not overwrite CSV file, instead append to it

#17 harendra-kumar closed 3 years ago
3
Format of the CSV file

#16 harendra-kumar closed 3 years ago
7
Elaborate the statistical model

#15 harendra-kumar closed 3 years ago
4
Not enough significant figures are shown

#14 bgamari closed 3 years ago
1
Font color might be indistinguishable from terminal foreground color

#13 0xd34df00d closed 3 years ago
3
Run an IO action in the bench without timing it

#12 kozross closed 3 years ago
10
Fix comparison against baseline for names with newlines

#11 Bodigrim closed 3 years ago
0
--pattern option seems to impact benchmark results?!

#10 sjakobi closed 3 years ago
14
Duplicate benchmark names result in nonsensical comparisons

#9 sjakobi closed 3 years ago
6
Can we get a probabilistic check of asymptotic complexity?

#8 kindaro closed 3 years ago
15
Remove the NFData constraint on whnfIO

#7 maoe closed 3 years ago
1