chore: debugging #329

maksymar · 2025-06-02T09:23:57Z

No description provided.

github-actions · 2025-06-02T09:37:42Z

`canbench` 🏋 (dir: ./benchmarks/compare) `41505bb` 2025-06-05 13:13:06 UTC

✅ ./benchmarks/compare/canbench_results.yml is up to date
📦 canbench_results_compare.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max +2.00M | p75 +18 | median +14 | p25 +9 | min -1.04B]
    change %: [max +0.04% | p75 0.00% | median 0.00% | p25 0.00% | min -1.15%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-02T09:37:42Z

`canbench` 🏋 (dir: ./benchmarks/btreemap) `41505bb` 2025-06-05 13:14:01 UTC

✅ ./benchmarks/btreemap/canbench_results.yml is up to date
📦 canbench_results_btreemap.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions detected! 🔴
    counts:   [total 285 | regressed 136 | improved 0 | new 0 | unchanged 149]
    change:   [max +32.87M | p75 +18.49M | median +16.82M | p25 +13.71M | min -12.27M]
    change %: [max +9.76% | p75 +2.80% | median +1.96% | p25 +1.00% | min -0.59%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                              | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|-----------------------------------|-------|---------|---------|----|--------|-----|---------|
|   +    | btreemap_v2_range_count_1k_0b     |       |  18.38K |  +9.76% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_range_key_sum_1k_0b   |       |  18.74K |  +9.56% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_range_value_sum_1k_0b |       |  18.75K |  +9.55% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_u64_blob8    |       | 242.62M |  +7.59% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_u64_vec8     |       | 242.62M |  +7.59% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_u64_u64      |       | 247.76M |  +7.38% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_u64_blob8         |       | 253.07M |  +7.26% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_u64_vec8          |       | 253.81M |  +7.23% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_u64_u64           |       | 259.29M |  +7.03% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_8_128   |       | 291.80M |  +6.75% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob8_u64    |       | 301.52M |  +6.45% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_blob_8_128        |       | 304.93M |  +6.45% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_vec_32_1024  |       | 549.22M |  +6.37% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_blob8_u64         |       | 312.78M |  +6.21% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_16_128  |       | 317.87M |  +5.92% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_vec_8_128    |       | 421.59M |  +5.86% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_vec_8_128         |       | 431.06M |  +5.73% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_get_blob_16_128       |       | 331.29M |  +5.67% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_16   |       | 346.67M |  +5.21% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_128  |       | 354.72M |  +5.18% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_8    |       | 352.65M |  +5.15% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_4    |       | 350.91M |  +5.14% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_512  |       | 350.27M |  +5.12% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_256  |       | 352.81M |  +5.10% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_32_1024 |       | 354.66M |  +5.10% |  0 |  0.00% |   0 |   0.00% |
|  ...   | ... 86 rows omitted ...           |       |         |         |    |        |     |         |
|   +    | btreemap_v2_pop_first_blob_32_32  |       | 863.85M |  +2.24% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_first_blob_32_4   |       | 831.57M |  +2.23% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_4      |       | 748.53M |  +2.23% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_512    |       | 645.41M |  +2.21% |  0 |  0.00% |  91 |   0.00% |
|   +    | btreemap_v2_get_vec_4_128         |       | 416.18M |  +2.21% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_32     |       | 763.72M |  +2.21% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_16     |       | 751.91M |  +2.20% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_vec8_u64       |       | 609.60M |  +2.18% |  0 |  0.00% |  16 |   0.00% |
|   +    | btreemap_v2_remove_vec_4_128      |       | 683.69M |  +2.18% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_64     |       | 790.92M |  +2.17% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_last_blob_32_128  |       | 881.43M |  +2.17% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_first_blob_32_64  |       | 872.15M |  +2.16% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_first_blob_32_128 |       | 914.05M |  +2.10% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_64_128    |       | 701.50M |  +2.09% |  0 |  0.00% |  34 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_128     |       |   1.09B |  +2.08% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_vec_32_16      |       | 703.07M |  +2.07% |  0 |  0.00% |  20 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_128    |       | 798.49M |  +2.06% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_last_blob_32_256  |       | 913.83M |  +2.05% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_vec_32_4       |       | 697.43M |  +2.04% |  0 |  0.00% |  20 |   0.00% |
|   +    | btreemap_v2_insert_vec_32_32      |       | 698.47M |  +2.04% |  0 |  0.00% |  20 |   0.00% |
|   +    | btreemap_v2_insert_vec_32_8       |       | 696.61M |  +2.02% |  0 |  0.00% |  20 |   0.00% |
|   +    | btreemap_v2_remove_vec8_u64       |       | 782.73M |  +2.02% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_first_vec_32_16   |       | 984.37M |  +2.01% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_pop_first_blob_32_256 |       | 942.51M |  +2.00% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_contains_blob_128_128 |       | 857.73M |  +2.00% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-02T09:37:43Z

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `ebeac8e` 2025-06-16 08:27:15 UTC

✅ ./benchmarks/memory_manager/canbench_results.yml is up to date
📦 canbench_results_memory-manager.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-02T09:37:45Z

`canbench` 🏋 (dir: ./benchmarks/vec) `ebeac8e` 2025-06-16 08:27:20 UTC

✅ ./benchmarks/vec/canbench_results.yml is up to date
📦 canbench_results_vec.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-16T08:28:36Z

`canbench` 🏋 (dir: ./benchmarks/btreeset) `ebeac8e` 2025-06-16 08:27:36 UTC

❌ ./benchmarks/btreeset/canbench_results.yml is not up to date
If the performance change is expected, run canbench --persist [--csv] to update the benchmark results.
📦 canbench_results_btreeset.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions detected 🔴
    counts:   [total 100 | regressed 6 | improved 0 | new 0 | unchanged 94]
    change:   [max +137.28K | p75 +4.11K | median +2.92K | p25 +1.42K | min -7.88M]
    change %: [max +3.29% | p75 +0.17% | median +0.05% | p25 0.01% | min -1.27%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 100 | regressed 0 | improved 0 | new 0 | unchanged 100]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 100 | regressed 0 | improved 0 | new 0 | unchanged 100]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                       | calls |    ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|----------------------------|-------|--------|---------|----|--------|-----|---------|
|   +    | btreeset_is_subset_u32     |       | 45.54K |  +3.29% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_is_subset_u64     |       | 46.19K |  +3.24% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_is_subset_blob_32 |       | 48.20K |  +3.03% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_is_subset_blob_8  |       | 54.97K |  +2.71% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_is_subset_blob_16 |       | 56.41K |  +2.64% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_is_subset_blob_64 |       | 59.42K |  +2.44% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

maksymar added 3 commits May 28, 2025 13:41

add scopes

5a8c336

merge main

0ec1b25

canbench main

4d8c480

maksymar changed the title ~~debugging~~ chore: debugging Jun 2, 2025

maksymar added 17 commits June 2, 2025 13:23

Merge branch 'main' into maksym/dbg-perf

6e2d9fb

--locked

4d96666

.

1b08e37

add scopes

fb00aa7

.

4c2331e

swap_value

4f78630

.

a57f58c

merge main

1dd4384

cleanup

2b7ecaf

read children vec

3b77d14

rename

c984f59

turn off bench_scope

c9699d9

merge main

382d2ae

revert reading children vec

d8ccd68

merge main

da51060

read_u64_vec

112d514

merge main

836af0a

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

chore: debugging #329

chore: debugging #329

Uh oh!

maksymar commented Jun 2, 2025

Uh oh!

github-actions bot commented Jun 2, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jun 2, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jun 2, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jun 2, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jun 16, 2025

Uh oh!

Uh oh!

chore: debugging #329

Are you sure you want to change the base?

chore: debugging #329

Uh oh!

Conversation

maksymar commented Jun 2, 2025

Uh oh!

github-actions bot commented Jun 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/compare) 41505bb 2025-06-05 13:13:06 UTC

Uh oh!

github-actions bot commented Jun 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/btreemap) 41505bb 2025-06-05 13:14:01 UTC

Uh oh!

github-actions bot commented Jun 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/memory_manager) ebeac8e 2025-06-16 08:27:15 UTC

Uh oh!

github-actions bot commented Jun 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/vec) ebeac8e 2025-06-16 08:27:20 UTC

Uh oh!

github-actions bot commented Jun 16, 2025

canbench 🏋 (dir: ./benchmarks/btreeset) ebeac8e 2025-06-16 08:27:36 UTC

Uh oh!

Uh oh!

github-actions bot commented Jun 2, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/compare) `41505bb` 2025-06-05 13:13:06 UTC

github-actions bot commented Jun 2, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/btreemap) `41505bb` 2025-06-05 13:14:01 UTC

github-actions bot commented Jun 2, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `ebeac8e` 2025-06-16 08:27:15 UTC

github-actions bot commented Jun 2, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/vec) `ebeac8e` 2025-06-16 08:27:20 UTC

`canbench` 🏋 (dir: ./benchmarks/btreeset) `ebeac8e` 2025-06-16 08:27:36 UTC