Benchmarks with tag 'apps': =========================== +----------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +================+===============+=======================+=======================+ | 2to3 | 249 ms | 247 ms: 1.01x faster | 247 ms: 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ | chameleon | 6.55 ms | 6.69 ms: 1.02x slower | 6.50 ms: 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ | html5lib | 60.3 ms | not significant | 59.0 ms: 1.02x faster | +----------------+---------------+-----------------------+-----------------------+ | tornado_http | 94.3 ms | 92.4 ms: 1.02x faster | 93.6 ms: 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.00x faster | 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ Benchmarks with tag 'math': =========================== +----------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +================+===============+=======================+=======================+ | nbody | 95.5 ms | 96.2 ms: 1.01x slower | not significant | +----------------+---------------+-----------------------+-----------------------+ | pidigits | 199 ms | 189 ms: 1.05x faster | 199 ms: 1.00x slower | +----------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.01x faster | 1.00x slower | +----------------+---------------+-----------------------+-----------------------+ Benchmark hidden because not significant (1): float Benchmarks with tag 'regex': ============================ +----------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +================+===============+=======================+=======================+ | regex_compile | 130 ms | 128 ms: 1.02x faster | 127 ms: 1.03x faster | +----------------+---------------+-----------------------+-----------------------+ | regex_dna | 200 ms | 204 ms: 1.02x slower | 202 ms: 1.01x slower | +----------------+---------------+-----------------------+-----------------------+ | regex_effbot | 3.37 ms | 3.39 ms: 1.00x slower | 3.40 ms: 1.01x slower | +----------------+---------------+-----------------------+-----------------------+ | regex_v8 | 21.5 ms | 21.2 ms: 1.01x faster | 21.2 ms: 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.00x faster | 1.01x faster | +----------------+---------------+-----------------------+-----------------------+ Benchmarks with tag 'serialize': ================================ +----------------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +======================+===============+=======================+=======================+ | json_dumps | 9.48 ms | 9.33 ms: 1.02x faster | 9.39 ms: 1.01x faster | +----------------------+---------------+-----------------------+-----------------------+ | json_loads | 24.4 us | 23.9 us: 1.02x faster | 24.0 us: 1.02x faster | +----------------------+---------------+-----------------------+-----------------------+ | pickle | 10.2 us | 10.3 us: 1.01x slower | not significant | +----------------------+---------------+-----------------------+-----------------------+ | pickle_dict | 30.9 us | 31.6 us: 1.02x slower | 30.8 us: 1.00x faster | +----------------------+---------------+-----------------------+-----------------------+ | pickle_list | 4.19 us | 4.15 us: 1.01x faster | 4.09 us: 1.03x faster | +----------------------+---------------+-----------------------+-----------------------+ | pickle_pure_python | 290 us | 285 us: 1.02x faster | 285 us: 1.02x faster | +----------------------+---------------+-----------------------+-----------------------+ | unpickle | 13.5 us | not significant | 14.1 us: 1.05x slower | +----------------------+---------------+-----------------------+-----------------------+ | unpickle_list | 5.01 us | 4.95 us: 1.01x faster | 4.93 us: 1.02x faster | +----------------------+---------------+-----------------------+-----------------------+ | unpickle_pure_python | 210 us | 205 us: 1.02x faster | 203 us: 1.03x faster | +----------------------+---------------+-----------------------+-----------------------+ | xml_etree_parse | 149 ms | not significant | 147 ms: 1.01x faster | +----------------------+---------------+-----------------------+-----------------------+ | xml_etree_iterparse | 103 ms | not significant | 101 ms: 1.01x faster | +----------------------+---------------+-----------------------+-----------------------+ | xml_etree_generate | 77.2 ms | 76.0 ms: 1.02x faster | 75.6 ms: 1.02x faster | +----------------------+---------------+-----------------------+-----------------------+ | xml_etree_process | 53.6 ms | 52.4 ms: 1.02x faster | 52.4 ms: 1.02x faster | +----------------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.01x faster | 1.01x faster | +----------------------+---------------+-----------------------+-----------------------+ Benchmarks with tag 'startup': ============================== +------------------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +========================+===============+=======================+=======================+ | python_startup | 8.63 ms | 8.60 ms: 1.00x faster | 8.67 ms: 1.00x slower | +------------------------+---------------+-----------------------+-----------------------+ | python_startup_no_site | 6.30 ms | 6.27 ms: 1.00x faster | 6.33 ms: 1.01x slower | +------------------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.00x faster | 1.00x slower | +------------------------+---------------+-----------------------+-----------------------+ Benchmarks with tag 'template': =============================== +-----------------+---------------+-----------------------+-----------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +=================+===============+=======================+=======================+ | django_template | 32.6 ms | not significant | 32.4 ms: 1.01x faster | +-----------------+---------------+-----------------------+-----------------------+ | genshi_text | 22.0 ms | 21.4 ms: 1.03x faster | 21.6 ms: 1.02x faster | +-----------------+---------------+-----------------------+-----------------------+ | genshi_xml | 49.7 ms | 48.7 ms: 1.02x faster | 48.6 ms: 1.02x faster | +-----------------+---------------+-----------------------+-----------------------+ | mako | 9.81 ms | 9.70 ms: 1.01x faster | 9.74 ms: 1.01x faster | +-----------------+---------------+-----------------------+-----------------------+ | Geometric mean | (ref) | 1.02x faster | 1.01x faster | +-----------------+---------------+-----------------------+-----------------------+ All benchmarks: =============== +-------------------------+---------------+------------------------+------------------------+ | Benchmark | main-2cfcaf5a | main-f4ad975 | stack-effect-48c2a209 | +=========================+===============+========================+========================+ | 2to3 | 249 ms | 247 ms: 1.01x faster | 247 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | aiohttp | 1.00 ms | 1000 us: 1.00x faster | 997 us: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | async_tree_cpu_io_mixed | 738 ms | 729 ms: 1.01x faster | 730 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | async_tree_io | 1.33 sec | 1.32 sec: 1.01x faster | 1.32 sec: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | async_tree_memoization | 658 ms | 636 ms: 1.04x faster | 626 ms: 1.05x faster | +-------------------------+---------------+------------------------+------------------------+ | chameleon | 6.55 ms | 6.69 ms: 1.02x slower | 6.50 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | chaos | 67.7 ms | 66.3 ms: 1.02x faster | 69.1 ms: 1.02x slower | +-------------------------+---------------+------------------------+------------------------+ | coroutines | 24.3 ms | 25.4 ms: 1.04x slower | 24.9 ms: 1.02x slower | +-------------------------+---------------+------------------------+------------------------+ | coverage | 98.8 ms | 97.8 ms: 1.01x faster | 97.8 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | crypto_pyaes | 74.0 ms | 74.6 ms: 1.01x slower | not significant | +-------------------------+---------------+------------------------+------------------------+ | deepcopy | 341 us | 325 us: 1.05x faster | 328 us: 1.04x faster | +-------------------------+---------------+------------------------+------------------------+ | deepcopy_reduce | 2.99 us | 2.92 us: 1.02x faster | 2.89 us: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | deepcopy_memo | 36.2 us | 34.4 us: 1.05x faster | 34.0 us: 1.07x faster | +-------------------------+---------------+------------------------+------------------------+ | deltablue | 3.32 ms | 3.26 ms: 1.02x faster | 3.27 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | django_template | 32.6 ms | not significant | 32.4 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | dulwich_log | 61.4 ms | 60.6 ms: 1.01x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | fannkuch | 365 ms | 386 ms: 1.06x slower | 375 ms: 1.03x slower | +-------------------------+---------------+------------------------+------------------------+ | generators | 75.9 ms | 75.4 ms: 1.01x faster | 74.0 ms: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | genshi_text | 22.0 ms | 21.4 ms: 1.03x faster | 21.6 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | genshi_xml | 49.7 ms | 48.7 ms: 1.02x faster | 48.6 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | go | 137 ms | 136 ms: 1.01x faster | 135 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | gunicorn | 1.08 ms | 1.08 ms: 1.00x faster | 1.07 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | hexiom | 6.17 ms | 6.04 ms: 1.02x faster | 6.04 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | html5lib | 60.3 ms | not significant | 59.0 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | json_dumps | 9.48 ms | 9.33 ms: 1.02x faster | 9.39 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | json_loads | 24.4 us | 23.9 us: 1.02x faster | 24.0 us: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | logging_format | 6.50 us | 6.40 us: 1.02x faster | 6.41 us: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | logging_silent | 94.7 ns | 93.7 ns: 1.01x faster | 93.5 ns: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | logging_simple | 5.83 us | 5.78 us: 1.01x faster | 5.78 us: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | mako | 9.81 ms | 9.70 ms: 1.01x faster | 9.74 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | mdp | 2.64 sec | 2.71 sec: 1.03x slower | 2.55 sec: 1.04x faster | +-------------------------+---------------+------------------------+------------------------+ | meteor_contest | 103 ms | 101 ms: 1.02x faster | 102 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | nbody | 95.5 ms | 96.2 ms: 1.01x slower | not significant | +-------------------------+---------------+------------------------+------------------------+ | nqueens | 79.4 ms | 78.6 ms: 1.01x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | pathlib | 17.9 ms | 17.6 ms: 1.02x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | pickle | 10.2 us | 10.3 us: 1.01x slower | not significant | +-------------------------+---------------+------------------------+------------------------+ | pickle_dict | 30.9 us | 31.6 us: 1.02x slower | 30.8 us: 1.00x faster | +-------------------------+---------------+------------------------+------------------------+ | pickle_list | 4.19 us | 4.15 us: 1.01x faster | 4.09 us: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | pickle_pure_python | 290 us | 285 us: 1.02x faster | 285 us: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | pidigits | 199 ms | 189 ms: 1.05x faster | 199 ms: 1.00x slower | +-------------------------+---------------+------------------------+------------------------+ | pprint_safe_repr | 678 ms | 673 ms: 1.01x faster | 669 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | pprint_pformat | 1.39 sec | 1.37 sec: 1.01x faster | 1.38 sec: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | pycparser | 1.09 sec | 1.07 sec: 1.02x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | pyflate | 404 ms | 409 ms: 1.01x slower | 401 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | pylint | 453 ms | not significant | 437 ms: 1.04x faster | +-------------------------+---------------+------------------------+------------------------+ | python_startup | 8.63 ms | 8.60 ms: 1.00x faster | 8.67 ms: 1.00x slower | +-------------------------+---------------+------------------------+------------------------+ | python_startup_no_site | 6.30 ms | 6.27 ms: 1.00x faster | 6.33 ms: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | raytrace | 288 ms | 281 ms: 1.02x faster | 277 ms: 1.04x faster | +-------------------------+---------------+------------------------+------------------------+ | regex_compile | 130 ms | 128 ms: 1.02x faster | 127 ms: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | regex_dna | 200 ms | 204 ms: 1.02x slower | 202 ms: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | regex_effbot | 3.37 ms | 3.39 ms: 1.00x slower | 3.40 ms: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | regex_v8 | 21.5 ms | 21.2 ms: 1.01x faster | 21.2 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | richards | 43.0 ms | 42.3 ms: 1.02x faster | 41.9 ms: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | scimark_fft | 312 ms | 315 ms: 1.01x slower | 318 ms: 1.02x slower | +-------------------------+---------------+------------------------+------------------------+ | scimark_lu | 107 ms | not significant | 110 ms: 1.03x slower | +-------------------------+---------------+------------------------+------------------------+ | scimark_monte_carlo | 67.9 ms | 66.4 ms: 1.02x faster | 66.2 ms: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | scimark_sor | 108 ms | not significant | 104 ms: 1.04x faster | +-------------------------+---------------+------------------------+------------------------+ | scimark_sparse_mat_mult | 4.17 ms | 3.95 ms: 1.05x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | spectral_norm | 97.1 ms | 93.9 ms: 1.03x faster | 98.2 ms: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | sqlglot_parse | 1.36 ms | 1.34 ms: 1.01x faster | 1.34 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | sqlglot_transpile | 1.65 ms | 1.63 ms: 1.01x faster | 1.64 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | sqlglot_optimize | 51.6 ms | 51.2 ms: 1.01x faster | 51.0 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | sqlglot_normalize | 108 ms | 105 ms: 1.02x faster | 104 ms: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | sqlite_synth | 2.57 us | 2.62 us: 1.02x slower | 2.61 us: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | sympy_expand | 458 ms | 454 ms: 1.01x faster | 454 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | sympy_integrate | 20.5 ms | not significant | 20.4 ms: 1.00x faster | +-------------------------+---------------+------------------------+------------------------+ | telco | 6.27 ms | not significant | 6.35 ms: 1.01x slower | +-------------------------+---------------+------------------------+------------------------+ | thrift | 742 us | 735 us: 1.01x faster | not significant | +-------------------------+---------------+------------------------+------------------------+ | tornado_http | 94.3 ms | 92.4 ms: 1.02x faster | 93.6 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | unpack_sequence | 47.0 ns | 50.3 ns: 1.07x slower | 43.1 ns: 1.09x faster | +-------------------------+---------------+------------------------+------------------------+ | unpickle | 13.5 us | not significant | 14.1 us: 1.05x slower | +-------------------------+---------------+------------------------+------------------------+ | unpickle_list | 5.01 us | 4.95 us: 1.01x faster | 4.93 us: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | unpickle_pure_python | 210 us | 205 us: 1.02x faster | 203 us: 1.03x faster | +-------------------------+---------------+------------------------+------------------------+ | xml_etree_parse | 149 ms | not significant | 147 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | xml_etree_iterparse | 103 ms | not significant | 101 ms: 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ | xml_etree_generate | 77.2 ms | 76.0 ms: 1.02x faster | 75.6 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | xml_etree_process | 53.6 ms | 52.4 ms: 1.02x faster | 52.4 ms: 1.02x faster | +-------------------------+---------------+------------------------+------------------------+ | Geometric mean | (ref) | 1.01x faster | 1.01x faster | +-------------------------+---------------+------------------------+------------------------+ Benchmark hidden because not significant (6): async_tree_none, float, json, mypy, sympy_sum, sympy_str