Skip to content

Enable GLM-5.3-Flash MTP on MI355X - #958

Merged
esmeetu merged 1 commit into
vllm-project:mainfrom
jamesETsmith:jamesETsmith/glm-5.3-flash-mtp-on-rocm
Sep 13, 2026
Merged

esmeetu merged 1 commit into
vllm-project:mainfrom
jamesETsmith:jamesETsmith/glm-5.3-flash-mtp-on-rocm

Conversation

@jamesETsmith

@jamesETsmith jamesETsmith commented Sep 11, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Replace the obsolete unsupported warning about MTP in the GLM-5.3-Flash MI355X recipe example now that vLLM's ROCm sparse-MLA dispatch fix has merged (see vllm-project/vllm#55239)

Testing

Validation: node scripts/build-recipes-api.mjs

@vercel

vercel Bot commented Sep 11, 2026 •

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vllm-recipes Ready Ready Preview Sep 11, 2026 2:56pm UTC

Request Review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the GLM-5.3-Flash.yaml model configuration. Specifically, it updates the last modified date, adds a speculative configuration argument (--speculative-config) to the guide command, and updates the documentation to reflect that MTP speculative decoding is now supported on MI355X with specific vLLM builds. No review comments were provided, so there is no additional feedback to address.

Update the ROCm guidance now that upstream sparse-MLA dispatch supports
MTP verification correctly.

💘 Generated with Crush

Assisted-by: Crush:gpt-5.6-sol
Signed-off-by: jamesETsmith <james.smith9113@gmail.com>
@jamesETsmith
jamesETsmith force-pushed the jamesETsmith/glm-5.3-flash-mtp-on-rocm branch from 19bc6b8 to d5a3998 Compare September 11, 2026 14:54
@jamesETsmith
jamesETsmith marked this pull request as ready for review September 11, 2026 16:40
@esmeetu

esmeetu commented Sep 13, 2026

Copy link
Copy Markdown
Member

lgtm!

@esmeetu
esmeetu merged commit 412ba72 into vllm-project:main Sep 13, 2026
4 checks passed

This branch was successfully deployed

1 active deployment
Preview — d5a39981 Deployed Sep 11, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants