MilesCranmer / AirspeedVelocity.jl

Easily benchmark a Julia package over its commit history
https://astroautomata.com/AirspeedVelocity.jl/
Apache License 2.0
105 stars 6 forks source link

feature requst: measure Time To First X (TTFX) without counting in Time To Load #4

Open Krastanov opened 1 year ago

Krastanov commented 1 year ago

The result of using PackageName; @time @eval some_custom_function(). It can not be part of BenchmarkGroup because we want to measure only the first run. A new process might be needed repeatedly to get a minimum.

Krastanov commented 1 year ago

Here is a shell script I am using for TTFX and TTL https://github.com/Krastanov/QuantumClifford.jl/blob/master/benchmark/run_ttfx_bechmarks.sh