Skip to content

Quant config refactor 3 - #65759

Draft
bnellnm wants to merge 6 commits into
vllm-project:mainfrom
neuralmagic:quant-config-refactor-3
Draft

bnellnm wants to merge 6 commits into
vllm-project:mainfrom
neuralmagic:quant-config-refactor-3

Conversation

@bnellnm

@bnellnm bnellnm commented Nov 4, 2026 •

Copy link
Copy Markdown
Collaborator

Overview

Claims

Validation

Details


Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Bill Nell <bnell@redhat.com>
…schema args from __init__

Signed-off-by: Bill Nell <bnell@redhat.com>
@mergify mergify Bot added ci/build deepseek Related to DeepSeek models quantization gpt-oss Related to GPT-OSS models minimax labels Nov 4, 2026
@mergify mergify Bot added DSv4.1 Related to DeepSeek-V4.1 models nvidia labels Nov 4, 2026
@mergify mergify Bot added the rocm Related to AMD ROCm label Nov 4, 2026
@mergify mergify Bot added the intel-gpu Related to Intel GPU label Nov 4, 2026
@mergify mergify Bot added the cpu Related to CPU backends label Nov 4, 2026
@github-project-automation github-project-automation Bot moved this to Todo in AMD Nov 4, 2026
@mergify mergify Bot added the batch-invariance Batch invariance and deterministic inference (VLLM_BATCH_INVARIANT) label Nov 4, 2026
@mergify

mergify Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @bnellnm.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added needs-rebase nixl NIXL KV connector / multi-tiered KV offloading (KVCR) labels Nov 4, 2026
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Bill Nell <bnell@redhat.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

batch-invariance Batch invariance and deterministic inference (VLLM_BATCH_INVARIANT) ci/build cpu Related to CPU backends deepseek Related to DeepSeek models DSv4.1 Related to DeepSeek-V4.1 models gpt-oss Related to GPT-OSS models intel-gpu Related to Intel GPU minimax needs-rebase nixl NIXL KV connector / multi-tiered KV offloading (KVCR) nvidia performance Performance-related issues quantization rocm Related to AMD ROCm

Projects

Status: Todo
Status: No status
Status: To Triage

Development

Successfully merging this pull request may close these issues.

1 participant