Compare a matrix of nogil to other upstreams

[mdboom]

In the PEP 703 update thread on discuss, @colesbury suggested a few things to measure and compare.

1. There is a newer version of nogil-3.12 than what we tested a few months ago. Sam suggested to use d595911.
2. This should be compared against an upstream with the immortal object merged. Sam suggested using 018be4c, but I can't find that commit, so I'm using ea2c001, which is the merge commit of PEP 683.

In addition, the Faster CPython feels that:

1. Comparing against the merge base of d595911, which is 3d5d3f7 is useful to see the measure the effect of only the nogil changes directly.
2. It is also useful comparing against an upstream which has the same gc thresholds as the nogil branch, since the effect of that alone is so large. (See #593)

Therefore, this issue is a place to report comparisons of a recent nogil commit (d595911) against:

• immortal: Upstream CPython immediately after the PEP 683 immortal objects changes were completed (ea2c001)
• gc: merge-base modified so that the gc thresholds match nogil (0fd3163)
• immortal-gc: PEP 683 (ea2c001) with the gc thresholds updated (82b39b9)
• merge-base: Upstream CPython at the point the nogil branch was created (3d5d3f7)

Summary of results:

vs.	pyperf compare_to	distribution plots
immortal	5% slower	2% slower
gc	14% slower	12% slower
immortal-gc	10% slower	8% slower
merge-base	9% slower	7% slower

EDIT 2023-06-07T21:00: Updated summary table to include both pyperf compare_to and distribution plot results. Added a new target immortal-gc.

[mdboom]

immortal results

Benchmarks with tag 'apps': =========================== 2to3: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 266 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.08x slower chameleon: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.84 ms +- 0.06 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.13x slower html5lib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 64.6 ms +- 2.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.06x slower Geometric mean: 1.09x slower Benchmarks with tag 'math': =========================== float: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 79.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.19x faster nbody: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 88.8 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.16x slower pidigits: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster Geometric mean: 1.01x faster Benchmarks with tag 'regex': ============================ regex_compile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 143 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.06x slower regex_dna: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 204 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.07x slower regex_effbot: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.32 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.06x slower regex_v8: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.3 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.01x faster Geometric mean: 1.04x slower Benchmarks with tag 'serialize': ================================ json_dumps: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.74 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.07x slower json_loads: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 24.9 us +- 0.4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower pickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.4 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.06x faster pickle_dict: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 31.7 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.06x faster pickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.43 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.01x slower pickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 308 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.02x slower unpickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 14.6 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower unpickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 5.41 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.01x faster unpickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 213 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.11x slower xml_etree_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 155 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.16x faster xml_etree_iterparse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.16x slower xml_etree_process: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 58.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.03x slower Benchmark hidden because not significant (1): xml_etree_generate Geometric mean: 1.02x slower Benchmarks with tag 'startup': ============================== python_startup: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.04 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.03x slower python_startup_no_site: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.64 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.01x slower Geometric mean: 1.02x slower Benchmarks with tag 'template': =============================== genshi_text: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.08x slower genshi_xml: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 50.0 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.04x slower mako: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.5 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.29x slower Geometric mean: 1.13x slower All benchmarks: =============== 2to3: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 266 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.08x slower async_generators: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 438 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.19x faster async_tree_none: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 529 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.83x faster async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 746 ms +- 28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.45x faster async_tree_io: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.30 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 2.24x faster async_tree_memoization: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 661 ms +- 32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.83x faster asyncio_tcp: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 501 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.07x slower chameleon: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.84 ms +- 0.06 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.13x slower chaos: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 68.0 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower comprehensions: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 23.2 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.16x slower bench_thread_pool: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 834 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 1.97x slower coroutines: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 21.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.15x slower crypto_pyaes: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 78.1 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.05x slower deepcopy: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 359 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.04x slower deepcopy_reduce: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.17 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.05x slower deepcopy_memo: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 37.5 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.07x slower deltablue: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.57 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.03x slower fannkuch: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 387 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.12x slower float: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 79.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.19x faster create_gc_cycles: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.51 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.01x faster gc_traversal: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.84 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.24x faster generators: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 30.4 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 2.58x slower genshi_text: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.08x slower genshi_xml: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 50.0 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.04x slower go: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 136 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.09x slower hexiom: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.25 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.10x slower html5lib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 64.6 ms +- 2.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.06x slower json: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.69 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.08x slower json_dumps: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.74 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.07x slower json_loads: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 24.9 us +- 0.4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower logging_format: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.93 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.12x slower logging_silent: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 95.9 ns +- 0.4 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.13x slower logging_simple: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.16 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.12x slower mako: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.5 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.29x slower mdp: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 2.58 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.14x slower meteor_contest: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 113 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.12x slower mypy2: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 360 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.24x slower nbody: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 88.8 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.16x slower nqueens: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 80.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.07x slower pathlib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 17.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.09x slower pickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.4 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.06x faster pickle_dict: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 31.7 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.06x faster pickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.43 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.01x slower pickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 308 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.02x slower pidigits: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster pprint_safe_repr: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 738 ms +- 11 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.05x slower pprint_pformat: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.51 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.06x slower pyflate: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 455 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.04x slower python_startup: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.04 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.03x slower python_startup_no_site: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.64 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.01x slower raytrace: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 296 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.17x slower regex_compile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 143 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.06x slower regex_dna: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 204 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.07x slower regex_effbot: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.32 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.06x slower regex_v8: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.3 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.01x faster richards: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 42.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.14x slower scimark_fft: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 347 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.08x slower scimark_lu: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 112 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.12x slower scimark_monte_carlo: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 72.0 ms +- 1.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.06x slower scimark_sor: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 118 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.06x slower scimark_sparse_mat_mult: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.70 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.04x slower spectral_norm: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 102 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.10x slower sqlglot_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.31 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.28x slower sqlglot_transpile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.63 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.21x slower sqlglot_optimize: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 54.2 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.02x slower sqlglot_normalize: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 111 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.03x slower sqlite_synth: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 2.68 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower sympy_expand: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 500 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.07x slower sympy_integrate: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 21.9 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.04x slower sympy_sum: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 181 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.06x slower sympy_str: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 315 ms +- 14 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.04x slower telco: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.69 ms +- 0.18 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.02x slower unpack_sequence: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 46.7 ns +- 0.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.11x slower unpickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 14.6 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower unpickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 5.41 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.01x faster unpickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 213 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.11x slower xml_etree_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 155 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.16x faster xml_etree_iterparse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.16x slower xml_etree_process: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 58.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.03x slower Benchmark hidden because not significant (3): bench_mp_pool, pycparser, xml_etree_generate Geometric mean: 1.05x slower Ignored benchmarks (11) of ../results/bm-20230422-3.12.0a7+-ea2c001/bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, pylint, sqlalchemy_declarative, sqlalchemy_imperative, thrift, tornado_http Ignored benchmarks (4) of ../results/bm-20230427-3.12.0a4-d595911/bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911.json: asyncio_tcp_ssl, richards_super, tomli_loads, typing_runtime_protocols 

[mdboom]

gc results

Benchmarks with tag 'apps': =========================== 2to3: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 245 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.17x slower chameleon: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.37 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.21x slower html5lib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 57.8 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.18x slower Geometric mean: 1.19x slower Benchmarks with tag 'math': =========================== float: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 60.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.10x slower nbody: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 92.3 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.12x slower pidigits: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster Geometric mean: 1.07x slower Benchmarks with tag 'regex': ============================ regex_compile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 131 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower regex_dna: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 210 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.04x slower regex_effbot: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.46 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.02x slower Benchmark hidden because not significant (1): regex_v8 Geometric mean: 1.05x slower Benchmarks with tag 'serialize': ================================ json_dumps: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.55 ms +- 0.28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.09x slower json_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.7 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.19x slower pickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 10.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.04x faster pickle_dict: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 31.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.05x faster pickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.05 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower pickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 282 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.12x slower tomli_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.98 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.21x slower unpickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.17x slower unpickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.95 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower unpickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 198 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.20x slower xml_etree_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 122 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.10x slower xml_etree_iterparse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 80.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.49x slower xml_etree_generate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.14x slower xml_etree_process: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.17x slower Geometric mean: 1.14x slower Benchmarks with tag 'startup': ============================== python_startup: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 8.24 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.13x slower python_startup_no_site: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.93 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.13x slower Geometric mean: 1.13x slower Benchmarks with tag 'template': =============================== genshi_text: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.20x slower genshi_xml: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 45.9 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.13x slower mako: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.69 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.40x slower Geometric mean: 1.24x slower All benchmarks: =============== 2to3: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 245 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.17x slower async_generators: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 338 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.09x slower async_tree_none: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 260 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.11x slower async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 469 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.10x slower async_tree_io: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 534 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 1.09x slower async_tree_memoization: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 315 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.15x slower asyncio_tcp: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 511 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.05x slower asyncio_tcp_ssl: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.79 sec +- 0.00 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.85 sec +- 0.01 sec: 1.03x slower chameleon: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.37 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.21x slower chaos: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 68.8 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.11x slower comprehensions: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.9 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.12x slower bench_thread_pool: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 792 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 2.07x slower coroutines: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 26.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.04x faster crypto_pyaes: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.7 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.11x slower deepcopy: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 332 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.12x slower deepcopy_reduce: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.97 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.12x slower deepcopy_memo: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 33.8 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.18x slower deltablue: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.11 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.18x slower fannkuch: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 368 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.17x slower float: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 60.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.10x slower create_gc_cycles: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.03x slower gc_traversal: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.38 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.09x faster generators: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 79.1 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 1.01x faster genshi_text: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.20x slower genshi_xml: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 45.9 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.13x slower go: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 137 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.07x slower hexiom: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.06 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.13x slower html5lib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 57.8 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.18x slower json: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.59 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.10x slower json_dumps: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.55 ms +- 0.28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.09x slower json_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.7 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.19x slower logging_format: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.44 us +- 0.14 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.20x slower logging_silent: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 89.6 ns +- 2.5 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.21x slower logging_simple: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.80 us +- 0.08 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.19x slower mako: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.69 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.40x slower mdp: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.48 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.19x slower meteor_contest: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 109 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.16x slower mypy2: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 309 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.44x slower nbody: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 92.3 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.12x slower nqueens: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 77.6 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.11x slower pathlib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 18.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.08x slower pickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 10.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.04x faster pickle_dict: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 31.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.05x faster pickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.05 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower pickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 282 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.12x slower pidigits: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster pprint_safe_repr: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 676 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.14x slower pprint_pformat: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.39 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.15x slower pycparser: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.06 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.08x slower pyflate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 403 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.18x slower python_startup: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 8.24 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.13x slower python_startup_no_site: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.93 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.13x slower raytrace: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 286 ms +- 7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.21x slower regex_compile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 131 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower regex_dna: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 210 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.04x slower regex_effbot: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.46 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.02x slower richards: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 42.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.15x slower richards_super: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 52.9 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.2 ms +- 0.4 ms: 1.14x slower scimark_fft: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 309 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.21x slower scimark_lu: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 105 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.19x slower scimark_monte_carlo: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 65.2 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.17x slower scimark_sor: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 106 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.18x slower scimark_sparse_mat_mult: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.12 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.19x slower spectral_norm: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 94.7 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.18x slower sqlglot_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.38 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.21x slower sqlglot_transpile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.67 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.18x slower sqlglot_optimize: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.07x slower sqlglot_normalize: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 108 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.05x slower sqlite_synth: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.67 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower sympy_expand: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 455 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.17x slower sympy_integrate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.13x slower sympy_sum: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 163 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.18x slower sympy_str: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 281 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.17x slower telco: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.52 ms +- 0.15 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.04x slower tomli_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.98 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.21x slower typing_runtime_protocols: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 463 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 us +- 2 us: 1.16x slower unpack_sequence: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 43.6 ns +- 0.8 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.19x slower unpickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.17x slower unpickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.95 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower unpickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 198 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.20x slower xml_etree_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 122 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.10x slower xml_etree_iterparse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 80.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.49x slower xml_etree_generate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.14x slower xml_etree_process: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.17x slower Benchmark hidden because not significant (2): bench_mp_pool, regex_v8 Geometric mean: 1.14x slower Ignored benchmarks (7) of ../results/bm-20230531-3.12.0a4-0fd3163/bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, thrift 

[mdboom]

immortal + gc results

Benchmarks with tag 'apps': =========================== 2to3: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 260 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.10x slower chameleon: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.91 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.12x slower html5lib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 62.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.09x slower Geometric mean: 1.10x slower Benchmarks with tag 'math': =========================== float: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 69.2 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.03x faster nbody: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 91.3 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.13x slower pidigits: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 197 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.06x faster Geometric mean: 1.01x slower Benchmarks with tag 'regex': ============================ regex_compile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 146 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.03x slower regex_dna: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower regex_effbot: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.38 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.04x slower regex_v8: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.00x slower Geometric mean: 1.03x slower Benchmarks with tag 'serialize': ================================ json_dumps: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 9.70 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.08x slower json_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 24.9 us +- 1.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower pickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.3 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.05x faster pickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.36 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.03x slower pickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 314 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.01x slower tomli_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.18 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.09x slower unpickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 14.5 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower unpickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 5.09 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.05x slower unpickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 218 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.08x slower xml_etree_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 124 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.07x slower xml_etree_iterparse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 79.5 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.52x slower xml_etree_generate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.4 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.06x slower xml_etree_process: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 56.6 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.07x slower Benchmark hidden because not significant (1): pickle_dict Geometric mean: 1.08x slower Benchmarks with tag 'startup': ============================== python_startup: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 8.83 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.06x slower python_startup_no_site: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.04x slower Geometric mean: 1.05x slower Benchmarks with tag 'template': =============================== genshi_text: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.06x slower genshi_xml: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.2 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.05x slower mako: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.28x slower Geometric mean: 1.12x slower All benchmarks: =============== 2to3: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 260 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.10x slower async_generators: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 411 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.12x faster async_tree_none: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 262 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.11x slower async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 469 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.09x slower async_tree_io: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 523 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 1.11x slower async_tree_memoization: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 318 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.14x slower asyncio_tcp: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 512 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.04x slower asyncio_tcp_ssl: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.80 sec +- 0.00 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.85 sec +- 0.01 sec: 1.03x slower chameleon: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.91 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.12x slower chaos: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 68.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower comprehensions: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.4 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.15x slower bench_thread_pool: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 846 us +- 6 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 1.94x slower coroutines: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.07x slower crypto_pyaes: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.05x slower deepcopy: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 361 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.03x slower deepcopy_reduce: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.20 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.04x slower deepcopy_memo: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 38.9 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.03x slower deltablue: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.55 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.03x slower fannkuch: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 390 ms +- 7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.11x slower float: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 69.2 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.03x faster create_gc_cycles: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.53 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.02x faster gc_traversal: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.72 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.20x faster generators: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 30.7 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 2.55x slower genshi_text: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.06x slower genshi_xml: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.2 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.05x slower go: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 138 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.07x slower hexiom: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.34 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.08x slower html5lib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 62.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.09x slower json: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.79 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.05x slower json_dumps: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 9.70 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.08x slower json_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 24.9 us +- 1.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower logging_format: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 7.00 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.11x slower logging_silent: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 97.5 ns +- 1.3 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.12x slower logging_simple: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.31 us +- 0.09 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.09x slower mako: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.28x slower mdp: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.56 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.15x slower meteor_contest: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 114 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.11x slower mypy2: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 337 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.32x slower nbody: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 91.3 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.13x slower nqueens: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 80.5 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.07x slower pathlib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 17.7 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.10x slower pickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.3 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.05x faster pickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.36 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.03x slower pickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 314 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.01x slower pidigits: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 197 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.06x faster pprint_safe_repr: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 732 ms +- 8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.06x slower pprint_pformat: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.49 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.07x slower pycparser: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.05 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.09x slower pyflate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 459 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.03x slower python_startup: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 8.83 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.06x slower python_startup_no_site: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.04x slower raytrace: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 304 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.14x slower regex_compile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 146 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.03x slower regex_dna: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower regex_effbot: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.38 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.04x slower regex_v8: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.00x slower richards: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 44.0 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.11x slower richards_super: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 55.0 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.2 ms +- 0.4 ms: 1.09x slower scimark_fft: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 353 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.06x slower scimark_lu: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 110 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.13x slower scimark_monte_carlo: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 72.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.05x slower scimark_sparse_mat_mult: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.62 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.06x slower spectral_norm: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 106 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.05x slower sqlglot_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.29 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.30x slower sqlglot_transpile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.61 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.22x slower sqlglot_optimize: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 55.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.01x slower sqlglot_normalize: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 112 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.02x slower sqlite_synth: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.68 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower sympy_expand: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 495 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.08x slower sympy_integrate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.04x slower sympy_sum: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 180 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.07x slower sympy_str: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 310 ms +- 11 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.06x slower telco: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.92 ms +- 0.16 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.02x faster tomli_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.18 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.09x slower typing_runtime_protocols: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 216 us +- 11 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 us +- 2 us: 2.48x slower unpack_sequence: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.8 ns +- 0.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.04x slower unpickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 14.5 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower unpickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 5.09 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.05x slower unpickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 218 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.08x slower xml_etree_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 124 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.07x slower xml_etree_iterparse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 79.5 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.52x slower xml_etree_generate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.4 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.06x slower xml_etree_process: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 56.6 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.07x slower Benchmark hidden because not significant (3): bench_mp_pool, pickle_dict, scimark_sor Geometric mean: 1.10x slower Ignored benchmarks (13) of ../results/bm-20230607-3.12.0a7+-82b39b9/bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9.json: aiohttp, coverage, dask, django_template, djangocms, docutils, dulwich_log, gunicorn, pylint, sqlalchemy_declarative, sqlalchemy_imperative, thrift, tornado_http 

[mdboom]

merge base results

Benchmarks with tag 'apps': =========================== 2to3: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 253 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.13x slower chameleon: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.46 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.20x slower html5lib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 59.8 ms +- 2.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.14x slower Geometric mean: 1.16x slower Benchmarks with tag 'math': =========================== float: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 72.2 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.08x faster nbody: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.1 ms +- 1.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.11x slower pidigits: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 192 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.03x faster Geometric mean: 1.00x faster Benchmarks with tag 'regex': ============================ regex_compile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 132 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower regex_dna: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower regex_effbot: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.49 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.01x slower regex_v8: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 21.1 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.04x slower Geometric mean: 1.06x slower Benchmarks with tag 'serialize': ================================ json_dumps: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.54 ms +- 0.32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.10x slower json_loads: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 24.3 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.16x slower pickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 10.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.02x faster pickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.02 us +- 0.03 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower pickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 285 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.10x slower unpickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.18x slower unpickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.96 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower unpickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 200 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.19x slower xml_etree_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 149 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.12x faster xml_etree_iterparse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 106 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.13x slower xml_etree_generate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 77.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.08x slower xml_etree_process: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 53.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.12x slower Benchmark hidden because not significant (1): pickle_dict Geometric mean: 1.08x slower Benchmarks with tag 'startup': ============================== python_startup: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 8.54 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.09x slower python_startup_no_site: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.09 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.10x slower Geometric mean: 1.10x slower Benchmarks with tag 'template': =============================== genshi_text: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.8 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.17x slower genshi_xml: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 46.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.11x slower mako: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.74 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.39x slower Geometric mean: 1.22x slower All benchmarks: =============== 2to3: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 253 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.13x slower async_generators: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 354 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.04x slower async_tree_none: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 521 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.80x faster async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 747 ms +- 14 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.45x faster async_tree_io: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.30 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 2.23x faster async_tree_memoization: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 616 ms +- 34 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.70x faster asyncio_tcp: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 504 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.06x slower chameleon: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.46 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.20x slower chaos: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 67.7 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower comprehensions: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 23.7 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.13x slower bench_thread_pool: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 782 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 2.10x slower coroutines: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 25.4 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.01x faster crypto_pyaes: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 75.7 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.08x slower deepcopy: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 339 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.10x slower deepcopy_reduce: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.99 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.11x slower deepcopy_memo: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 34.7 us +- 0.7 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.16x slower deltablue: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.25 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.13x slower fannkuch: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 362 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.19x slower float: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 72.2 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.08x faster create_gc_cycles: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.45 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.03x slower gc_traversal: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.57 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.15x faster generators: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 79.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 1.01x faster genshi_text: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.8 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.17x slower genshi_xml: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 46.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.11x slower go: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 135 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.09x slower hexiom: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 5.98 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.15x slower html5lib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 59.8 ms +- 2.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.14x slower json: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.74 ms +- 0.16 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.06x slower json_dumps: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.54 ms +- 0.32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.10x slower json_loads: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 24.3 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.16x slower logging_format: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.35 us +- 0.11 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.22x slower logging_silent: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.5 ns +- 1.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.16x slower logging_simple: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 5.77 us +- 0.07 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.19x slower mako: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.74 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.39x slower mdp: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.66 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.11x slower meteor_contest: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 104 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.21x slower mypy2: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 332 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.34x slower nbody: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.1 ms +- 1.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.11x slower nqueens: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 78.0 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.11x slower pathlib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 18.0 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.08x slower pickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 10.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.02x faster pickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.02 us +- 0.03 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower pickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 285 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.10x slower pidigits: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 192 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.03x faster pprint_safe_repr: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 680 ms +- 9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.14x slower pprint_pformat: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.38 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.16x slower pycparser: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.08 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.06x slower pyflate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 397 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.20x slower python_startup: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 8.54 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.09x slower python_startup_no_site: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.09 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.10x slower raytrace: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 284 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.22x slower regex_compile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 132 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower regex_dna: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower regex_effbot: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.49 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.01x slower regex_v8: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 21.1 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.04x slower richards: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 42.3 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.15x slower scimark_fft: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 314 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.19x slower scimark_lu: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 107 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.16x slower scimark_monte_carlo: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 65.7 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.16x slower scimark_sor: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 108 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.16x slower scimark_sparse_mat_mult: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.13 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.19x slower spectral_norm: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 95.0 ms +- 2.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.18x slower sqlglot_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.41 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.19x slower sqlglot_transpile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.69 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.16x slower sqlglot_optimize: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 50.7 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.09x slower sqlglot_normalize: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.09x slower sqlite_synth: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.57 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.29x slower sympy_expand: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 455 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.17x slower sympy_integrate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.3 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.12x slower sympy_sum: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 163 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.18x slower sympy_str: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 282 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.16x slower telco: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.26 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.09x slower unpack_sequence: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 41.4 ns +- 0.5 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.25x slower unpickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.18x slower unpickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.96 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower unpickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 200 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.19x slower xml_etree_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 149 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.12x faster xml_etree_iterparse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 106 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.13x slower xml_etree_generate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 77.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.08x slower xml_etree_process: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 53.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.12x slower Benchmark hidden because not significant (2): bench_mp_pool, pickle_dict Geometric mean: 1.09x slower Ignored benchmarks (7) of ../results/bm-20230110-3.12.0a4-3d5d3f7/bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, thrift Ignored benchmarks (4) of ../results/bm-20230427-3.12.0a4-d595911/bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911.json: asyncio_tcp_ssl, richards_super, tomli_loads, typing_runtime_protocols