Skip to content

Upstream sync 11/N: merge 9d808e2309 fastsafetensors loader (conflict) - #1105

Merged
eble-amd merged 2 commits into
rogarcia.merge-upstream-10from
rogarcia.merge-upstream-11
Aug 13, 2026
Merged

eble-amd merged 2 commits into
rogarcia.merge-upstream-10from
rogarcia.merge-upstream-11

Conversation

@roberteg16

@roberteg16 roberteg16 commented Aug 13, 2026 •

Copy link
Copy Markdown

Context

Eleventh step of the batched upstream catch-up. Stacked on #1103; the chain below it is #1100 → #1101 → #1102 → #1103 (#1097 and #1098 have landed on gfx11).

Conflict-only step: exactly one upstream commit.

Merged upstream commit 9d808e2309 "[Core] Use fastsafetensors ParallelLoader for weight loading (vllm-project#40183)"
Landed on upstream main 2026-06-16 05:32 UTC
Commits in this PR 1
Upstream size 3 files, +68 / −56

Conflict and resolution

vllm/envs.py — same shape as #1102: both sides append declarations to the same block. The fork's AWQ switches (VLLM_USE_TRITON_AWQ_GEMV, VLLM_ALLOW_UNFUSED_AWQ_GEMM, VLLM_AWQ_USE_TN_GEMM) and upstream's VLLM_FASTSAFETENSORS_QUEUE_SIZE. Purely additive — kept both.

Post-merge checks

  • All four declarations still have a matching runtime entry in the environment_variables dict.
  • envs.py is the only fork-modified file this commit touches; the other two (weight_utils.py and a fastsafetensors test) carry no fork changes, so there is no fork code depending on the refactored loader API.

Test plan

gitbisector and others added 2 commits June 15, 2026 22:32
…oject#40183)

Signed-off-by: Git Bisector <gitbisector@gmail.com>
Signed-off-by: gitbisector <gitbisector@gmail.com>
Signed-off-by: git bisector <gitbisector@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Conflict-only step of the upstream catch-up. 9d808e2 is "[Core] Use
fastsafetensors ParallelLoader for weight loading (vllm-project#40183)".

vllm/envs.py: both sides append declarations to the same block - the fork's
AWQ switches and upstream's VLLM_FASTSAFETENSORS_QUEUE_SIZE. Purely
additive, keep both. Verified each of the four still has a matching runtime
entry in the environment_variables dict.

envs.py is the only fork-modified file the commit touches; its other two
files (weight_utils.py and a fastsafetensors test) carry no fork changes.

Signed-off-by: Robert Esclapez Garcia <robert.garcia@amd.com>
@roberteg16
roberteg16 marked this pull request as ready for review August 13, 2026 14:57
@eble-amd
eble-amd merged commit 71b5d0b into rogarcia.merge-upstream-10 Aug 13, 2026
5 checks passed
@roberteg16
roberteg16 deleted the rogarcia.merge-upstream-11 branch August 28, 2026 18:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants