SpeedyWeather / SpeedyWeather.jl

Play atmospheric modelling like it's LEGO.
https://speedyweather.github.io/SpeedyWeather.jl/dev
MIT License
400 stars 24 forks source link

Benchmark overview #509

Closed milankl closed 2 months ago

milankl commented 2 months ago

fixes #464

@vavrines this is a PR to address your point on performance documentation

Benchmark overview looks like

https://github.com/SpeedyWeather/SpeedyWeather.jl/blob/mk/benchmark/benchmark/

@maximilian-gelbrecht I found a manual benchmark that we can update every now and then easier to implement. Another option would be to let the documentation do this, in the end it's not that costly, most simulations run for O(1s) so it could be part of the documentation as well.

Weather is speedy: 100%|██████████████████| Time: 0:00:02 (21.82 millenia/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:03 (12.82 millenia/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (578.74 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (446.10 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (37.08 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:02 (36.91 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (52.94 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (53.15 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:00 (76.02 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (60.26 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (415.54 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (181.30 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (49.74 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:02 (21.16 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:06 ( 6.03 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:12 ( 2.24 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (400.37 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (614.87 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (543.04 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:04 (10.43 millenia/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:03 ( 4.61 millenia/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:02 (1298.60 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (496.44 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (120.91 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (42.22 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 ( 9.29 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:02 (329.03 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:02 (385.37 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (516.45 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (694.12 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (728.72 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:04 (679.86 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (388.93 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:01 (258.21 years/day)
Weather is speedy: 100%|██████████████████| Time: 0:00:00 (195.51 years/day)
milankl commented 2 months ago

@maximilian-gelbrecht the "automatic" testing is now simply by rerunning julia manual_benchmarking.jl. It will recreate the benchmark/README.md file so that we can regularly assess performance and compare across versions.