Repository navigation
[Klaud Cold] Add day-0 MiniMax-M3.1-Flash B200 vLLM AgentX DSpark recipe / [Klaud Cold] 新增 MiniMax-M3.1-Flash B200 vLLM AgentX DSpark 首日配方 - #4426
Merged
Conversation
…h B200 DSpark recipe TP4 drafts 7 DSpark tokens, DEP4 drafts 3; throughput runs use the minimaxm31flash_dspark golden AL from #4425.
Oseltamivir
requested review from
Ankur-singh,
RohitNagraj,
kedarpotdar-nv,
nvpohanh and
wzhao18
as code owners
October 23, 2026 05:07
Contributor
|
Thanks for the contribution!
中文感谢你的贡献!
|
Contributor
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=39904043266 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=39904043266 |
Collaborator
Author
|
/use 39904043266 |
Contributor
|
@Oseltamivir staging run 39904043266. Existing staged runs will be preserved; a completion link will be posted here. |
This was referenced Oct 23, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Day-0 MiniMax-M3.1-Flash (
MiniMaxAI/MiniMax-M3.1-Flash, ~428B/23B active, MXFP8 dense + NVFP4 experts, QAT for an NVFP4 KV cache) AgentX recipe on B200 with DSpark, following the vLLM day-0 blog and recipes.vllm.ai. B300 is in #4421, which also adds thedocs/MODELS.mdrow.minimaxm31flash-fp4-b200-vllm-agentic-dspark, recipeminimaxm31flash/vllm/b200-fp4-mtp/agentic.yaml.vllm/vllm-openai:minimax-m31-flash@sha256:86f582da…(day-0 multi-arch build, verified on Docker Hub).block-size 128,kv-cache-dtype nvfp4,attention-config {"indexer_kv_dtype":"nvfp4","use_prefill_query_quantization":true},FULL_AND_PIECEWISEcudagraphs,disable-hybrid-kv-cache-manager,minimax_m3reasoning/tool parsers,language-model-only,VLLM_FLOAT32_MATMUL_PRECISION=high.{"method":"dspark","attention_backend":"FLASH_ATTN","kv_cache_dtype":"fp8","draft_sample_method":"probabilistic","rejection_sample_method":"block"}. Throughput runs use synthetic acceptance from the golden curveminimaxm31flash_dspark.yaml([Klaud Cold] Add MiniMax-M3.1-Flash DSpark golden AL curve and SPEED-Bench collector / [Klaud Cold] 新增 MiniMax-M3.1-Flash DSpark 黄金 AL 曲线与 SPEED-Bench 采集脚本 #4425).