Skip to content

Measure installed checks with transitive dependency traversal - #1498

Draft
zaniebot wants to merge 13 commits into
zb/bench-installed-environmentfrom
zb/bench-ablate-no-deps
Draft

zaniebot wants to merge 13 commits into
zb/bench-installed-environmentfrom
zb/bench-ablate-no-deps

Conversation

@zaniebot

Copy link
Copy Markdown
Collaborator

Revert astral-sh#21523 to measure the cost of traversing transitive dependencies during an already-satisfied uv pip install --no-deps invocation. The comparison uses the real Prefect environment in the base branch.

@astral-automations-bot astral-automations-bot Bot added area:benchmarks Related to benchmarking internal A refactor or improvement that is not user-facing labels Sep 11, 2026
@codspeed

codspeed Bot commented Sep 11, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 11.92%

❌ 2 regressed benchmarks
✅ 90 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime fresh_hardlink[flask] 2.9 ms 3.4 ms -13.25%
❌ WallTime fresh_copy[flask] 56.2 ms 62.8 ms -10.57%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing zb/bench-ablate-no-deps (4b3499d) with zb/bench-installed-environment (ebcf207)

Open in CodSpeed

@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch from fd12079 to 7029c60 Compare September 11, 2026 22:41
@zaniebot
zaniebot force-pushed the zb/bench-ablate-no-deps branch from 4571e16 to 013adc0 Compare September 11, 2026 22:42
@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch 3 times, most recently from 83677f0 to c1bed75 Compare September 12, 2026 00:39
@zaniebot
zaniebot force-pushed the zb/bench-ablate-no-deps branch from 013adc0 to 47f5c0d Compare September 12, 2026 01:23
@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch from c1bed75 to 98a6021 Compare September 12, 2026 04:16
@zaniebot
zaniebot force-pushed the zb/bench-ablate-no-deps branch from 47f5c0d to 3a0ac59 Compare September 12, 2026 06:06
@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch from 98a6021 to cbb2eed Compare September 12, 2026 06:32
@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch from cbb2eed to ebcf207 Compare September 12, 2026 07:00
@zaniebot
zaniebot force-pushed the zb/bench-ablate-no-deps branch from 3a0ac59 to 4b3499d Compare September 12, 2026 07:50
@zaniebot
zaniebot force-pushed the zb/bench-installed-environment branch from ebcf207 to e1556cc Compare September 12, 2026 13:26
@zaniebot zaniebot added risk:3 Credible risk of meaningful incorrect behavior or regression; bounded or recoverable. priority:5 Backlog: speculative, cosmetic, or low-value work that can comfortably be deferred. labels Sep 22, 2026
@zaniebot zaniebot added the size:2 Moderate: one subsystem with meaningful invariants, edge cases, or operational evidence to inspect. label Sep 22, 2026
@zaniebot zaniebot added the build:skip-release Disable building release binaries for a pull request label Oct 7, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:benchmarks Related to benchmarking build:skip-release Disable building release binaries for a pull request internal A refactor or improvement that is not user-facing priority:5 Backlog: speculative, cosmetic, or low-value work that can comfortably be deferred. risk:3 Credible risk of meaningful incorrect behavior or regression; bounded or recoverable. size:2 Moderate: one subsystem with meaningful invariants, edge cases, or operational evidence to inspect.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants