Skip to content

[Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend - #59679

Merged
DarkLight1337 merged 3 commits into
vllm-project:mainfrom
hmellor:transformers-backend-glm-arcee-cwm
Oct 2, 2026
Merged

DarkLight1337 merged 3 commits into
vllm-project:mainfrom
hmellor:transformers-backend-glm-arcee-cwm

Conversation

@hmellor

@hmellor hmellor commented Oct 1, 2026 •

Copy link
Copy Markdown
Member

Overview

Move Glm, Arcee, CWM and Mellum from native vLLM implementations to the Transformers modeling backend, following #53615. Removes 3 model files (~650 lines); all four architectures remain officially supported.

Claims

  • GlmForCausalLM, ArceeForCausalLM, CwmForCausalLM → TransformersForCausalLM; MellumForCausalLM → TransformersMoEForCausalLM.
  • Deletes glm.py, arcee.py and mellum.py. CWM was a registry alias of LlamaForCausalLM, so it only needs a registry change.
  • gsm8k accuracy and throughput match main within run-to-run noise for all four models.
  • Docs rows move into the "supported via the Transformers modeling backend" table.

Validation

1x B200 per model, main (d848c4ed3d) vs this branch, transformers 5.17.0.

Model gsm8k main gsm8k branch Output tok/s main Output tok/s branch
zai-org/glm-4-9b-chat-hf 0.637 0.650 7,481 7,591
arcee-ai/AFM-4.5B-Base 0.518 0.521 13,657 13,820
facebook/cwm 0.850 0.852 1,761 1,766
JetBrains/Mellum2-12B-A2.5B-Base 0.803 0.809 16,604 16,498

Throughput is from one run per cell, so the ±1.5% differences are noise, not a speedup or regression.

gsm8k (5-shot, 1319 questions):

vllm serve <model> --port 8200 --max-model-len 8192 --gpu-memory-utilization 0.6
python tests/evals/gsm8k/gsm8k_eval.py --port 8200

Throughput:

vllm bench throughput --model <model> \
  --max-model-len 8192 --gpu-memory-utilization 0.6 \
  --input-len 1024 --output-len 256 --num-prompts 1000

Tests:

pytest tests/models/test_initialization.py -k "ArceeForCausalLM or CwmForCausalLM or GlmForCausalLM or MellumForCausalLM"  # 4 passed (B200)
pytest tests/models/test_registry.py  # 390 passed, 18 skipped

Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

🤖 Generated with Claude Code

hmellor and others added 2 commits October 1, 2026 20:16
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mergify

mergify Bot commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Documentation preview: https://vllm--59679.org.readthedocs.build/en/59679/

@mergify mergify Bot added documentation Improvements or additions to documentation glm labels Oct 1, 2026

@DarkLight1337 DarkLight1337 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@DarkLight1337

Copy link
Copy Markdown
Member

/ci run

@github-actions github-actions Bot added the ready ONLY add when PR is ready to merge/full CI is needed label Oct 2, 2026
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #92531 for commit 3b7dedd38bfc.

@DarkLight1337
DarkLight1337 merged commit 8faacd7 into vllm-project:main Oct 2, 2026
147 checks passed
@hmellor
hmellor deleted the transformers-backend-glm-arcee-cwm branch October 2, 2026 07:10
michael-gpu pushed a commit to practical-inference/vllm-ampere-extended that referenced this pull request Oct 20, 2026
…ng backend (vllm-project#59679)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation glm ready ONLY add when PR is ready to merge/full CI is needed

Projects

Development

Successfully merging this pull request may close these issues.

2 participants