Skip to content

Fix tied weights in weight mapping test for Transformers v5 - #36788

Merged
DarkLight1337 merged 1 commit into
vllm-project:mainfrom
hmellor:fix-weight-mapping-test
Mar 11, 2026
Merged

DarkLight1337 merged 1 commit into
vllm-project:mainfrom
hmellor:fix-weight-mapping-test

Conversation

@hmellor

@hmellor hmellor commented Mar 11, 2026

Copy link
Copy Markdown
Member

Remove the workaround in create_dummy_model as huggingface/transformers#43522 is now resolved

Add a new workaround for tied weights in Transformers v5 when:

  • The tied weight is in the checkpoint (and therefore in the ref_weight_names derived from the safetensors file)
  • tie_word_embeddings was not present in the config in Transformers v4
  • tie_word_embeddings is now present in the config in Transformers v5 and is True
  • The newly tied weights are no longer present in named_parameters, leading to missing_weights containing whatever was not correctly tied before

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@mergify mergify Bot added the multi-modality Related to multi-modality (#4194) label Mar 11, 2026
@DarkLight1337
DarkLight1337 enabled auto-merge (squash) March 11, 2026 13:19
@github-actions github-actions Bot added the ready ONLY add when PR is ready to merge/full CI is needed label Mar 11, 2026
@DarkLight1337
DarkLight1337 merged commit d5816c8 into vllm-project:main Mar 11, 2026
18 checks passed
@hmellor
hmellor deleted the fix-weight-mapping-test branch March 11, 2026 15:12
wendyliu235 pushed a commit to wendyliu235/vllm-public that referenced this pull request Mar 18, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
khairulkabir1661 pushed a commit to khairulkabir1661/vllm that referenced this pull request Mar 27, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
mtparet pushed a commit to blackfuel-ai/vllm that referenced this pull request Apr 9, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request May 10, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request May 15, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request May 19, 2026
…ject#36788)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants