Repository navigation
Better weight tying check for multimodal models - #38035
Merged
Merged
Conversation
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
hmellor
requested review from
ProExpertProg,
WoosukKwon,
houseroad,
mgoin,
robertgshaw2-redhat,
tlrmchlsmth,
yewentao256 and
youkaichao
as code owners
March 24, 2026 21:08
Contributor
There was a problem hiding this comment.
Code Review
This pull request refines the logic within the with_hf_config method in vllm/config/vllm.py by simplifying the conditional check for tie_word_embeddings in multimodal models. The change removes a redundant check for the absence of tie_word_embeddings in the text configuration. Additionally, the accompanying comments have been significantly expanded to provide a more detailed and accurate explanation of how tie_word_embeddings should be handled across different multimodal model architectures, clarifying its relationship between the main model configuration and the language model's specific configuration. There is no feedback to provide from the review comments.
DarkLight1337
approved these changes
Mar 25, 2026
DarkLight1337
enabled auto-merge (squash)
March 25, 2026 02:33
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
RhizoNymph
pushed a commit
to RhizoNymph/vllm
that referenced
this pull request
Mar 26, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
nithinvc
pushed a commit
to nithinvc/vllm
that referenced
this pull request
Mar 27, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
JiantaoXu
pushed a commit
to JiantaoXu/vllm
that referenced
this pull request
Mar 28, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
puririshi98
pushed a commit
to puririshi98/vllm
that referenced
this pull request
Apr 7, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: Rishi Puri <riship@nvidia.com>
mtparet
pushed a commit
to blackfuel-ai/vllm
that referenced
this pull request
Apr 9, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
mystous
pushed a commit
to mystous/vllm_hybrid
that referenced
this pull request
May 10, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
my-other-github-account
pushed a commit
to my-other-github-account/vllm
that referenced
this pull request
May 15, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This was referenced Jun 23, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
For some models,
SomeVLTextConfigmay also have atie_word_embeddingsfield. This is only the case ifSomeVLTextConfigis also used for a text only version of the same model. For example:Therefore, the presence of
tie_word_embeddingsinSomeVLTextConfigcannot be used as a signal for whethertie_word_embeddingsshould be copied fromhf_configto thelanguage_modelconfig.