Skip to content

Benchmark parsing published core metadata - #1485

Draft
zaniebot wants to merge 1 commit into
zb/bench-native-package-buildfrom
zb/bench-core-metadata
Draft

zaniebot wants to merge 1 commit into
zb/bench-native-package-buildfrom
zb/bench-core-metadata

Conversation

@zaniebot

Copy link
Copy Markdown
Collaborator

Dependency metadata varies substantially between small libraries and packages with many optional integrations. Add CPU benchmarks using the published Flask, JupyterLab, and Airflow core-metadata sidecars. Measure metadata parsing and the parsing and formatting of their real dependency requirements independently, covering the allocation-sensitive paths changed by astral-sh#10476 and astral-sh#20206.

@zaniebot
zaniebot added this pull request to stack #1482 September 11, 2026 21:55
@astral-automations-bot astral-automations-bot Bot added area:benchmarks Related to benchmarking internal A refactor or improvement that is not user-facing labels Sep 11, 2026
@codspeed

codspeed Bot commented Sep 11, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 13.37%

⚡ 1 improved benchmark
✅ 68 untouched benchmarks
🆕 9 new benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ WallTime fresh_copy[flask] 59.3 ms 52.3 ms +13.37%
🆕 Simulation format_requirements[airflow] N/A 1.8 ms N/A
🆕 Simulation format_requirements[flask] N/A 54.5 µs N/A
🆕 Simulation format_requirements[jupyterlab] N/A 232.3 µs N/A
🆕 Simulation parse_requirements[airflow] N/A 3.5 ms N/A
🆕 Simulation parse_requirements[flask] N/A 85.4 µs N/A
🆕 Simulation parse_requirements[jupyterlab] N/A 357.3 µs N/A
🆕 Simulation read[airflow] N/A 4.5 ms N/A
🆕 Simulation read[flask] N/A 163.1 µs N/A
🆕 Simulation read[jupyterlab] N/A 563.6 µs N/A

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing zb/bench-core-metadata (be282ce) with zb/bench-native-package-build (19d0d0a)1

Open in CodSpeed

Footnotes

  1. No successful run was found on zb/bench-native-package-build (5e65265) during the generation of this report, so c324134 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@zaniebot
zaniebot force-pushed the zb/bench-core-metadata branch from 6c56988 to be282ce Compare September 12, 2026 13:25
@zaniebot zaniebot added risk:1 Negligible risk of localized mistakes that are obvious and easy to correct. priority:3 Normal: useful features, documentation, usability, or routine efficiency improvements. size:1 Small: one localized behavior with straightforward tests or documentation checks. labels Sep 22, 2026
@zaniebot zaniebot added the build:skip-release Disable building release binaries for a pull request label Oct 7, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:benchmarks Related to benchmarking build:skip-release Disable building release binaries for a pull request internal A refactor or improvement that is not user-facing priority:3 Normal: useful features, documentation, usability, or routine efficiency improvements. risk:1 Negligible risk of localized mistakes that are obvious and easy to correct. size:1 Small: one localized behavior with straightforward tests or documentation checks.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants