Repository navigation
Conversation
…onokernel The daily arm was still on the October 20 image. Point it at today's ROCm 7.2 image and enable the AMD monokernel for TP4 widths 1-8 and the EAGLE verify chain this recipe already uses.
The daily tag moves from 20261116 to 20261117 so the arm uses the image built after the monokernel pin.
|
Thanks for the contribution!
中文感谢你的贡献!
|
| - "Concurrency 1 and 4 (latency_specialized decode backend) pick up the seungrokj/mum#28 levers through their defaults (all 1): VLLM_K31_BEAT_MARKOV, VLLM_K31_BEAT_DRAFTMETA, VLLM_K31_BEAT_K2SYNC, VLLM_K31_BEAT_EAGERPREP, VLLM_K31_BEAT_KDAK1 and VLLM_K3_INDEXER_SAMPLED_TOPK, plus VLLM_KIMI_SD_DSA_PROLOGUE_INDEXER at concurrency 1, where VLLM_KIMI_SD_DSA_PROLOGUE is on. Concurrency 16-48 use the stock decode backend, which ignores these flags." | ||
| - "No change to layouts, draft token counts, capture sizes or the DSpark draft's data types." | ||
| pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/5089 | ||
| pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/5089 |
There was a problem hiding this comment.
🔴 Merging this rewrites a byte in an existing changelog entry, which the repo forbids. The changelog conflict tooling treats this file as append-only. The hunk strips two trailing spaces from the previous entry's pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/5089 line at perf-changelog.yaml:12920. AGENTS.md:88 says to preserve every existing byte and append only at the tail. Fix: restore the two trailing spaces on line 12920 exactly as on the base, and change only the lines after it to add the new block.
Why this was flagged
The diff removes from the end of line 12920 (pr-link: .../pull/5089), which belongs to the entry before this PR's new block. AGENTS.md:88 says perf-changelog.yaml is append-only and byte-sensitive, and conflicts must be resolved only with the changelog conflict helper. On the base branch that line ends with two spaces, so this PR edits a historical entry rather than only appending. Another open PR that also appends after the #5089 entry will then conflict on that line, and the append-only helper and checks that assume an unchanged prefix see a modified existing byte. No safeguard in the diff keeps the old bytes, because the editor's trailing-whitespace stripping touched the context line.
Verification: Trigger: any run of the repo's changelog tooling on this PR's diff. The hunk replaces pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/5089 $ with ...pull/5089$. infx/matrix/plan.py:62-69 raises ValueError("Deletions are not allowed in ...") for the removed non-blank line, so the PR sweep fails at validation and the post-merge ingest fails too.
Qwen3.5-397B-A17B FP8 on MI355X still ran AgentX from
lmsysorg/sglang-rocm:v0.5.22-rocm720-mi35x-20261020with SGLang's own decode. This movesqwen3.5-fp8-mi355x-sglang-agentic-mtptolmsysorg/sglang-rocm:v0.5.23-rocm720-mi35x-20261117and adds--enable-amd-monokernel.sgl_amd_mono.qwen35_a17bserves TP4 decode widths 1–8 and this recipe's EAGLE chain (topk 1, 3 steps, 4 draft tokens). Wider steps stay on SGLang's forward. The concurrency grid, HiCache sizes, and draft token counts are unchanged.The ROCm image installs the
sgl-amd-monocommit pinned in SGLang. sgl-project/sglang#50813 pinsa04ceab, the merge of sgl-project/sgl-amd-mono#58, soqwen35_a17bis in the 20261117 tag when that pin is in the build.AI model disclosure
Prepared by Grok 4.7 in Cursor. The model edited the image pin, the server flag, and the performance changelog, and opened this pull request.