Repository navigation
Conversation
…and graph timing admission
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
MTP-off state-only factorization at fork
56cdc14515daa4d4a586ec4d5d1be70af8a053cfpassed the full numerical, static, length and 900-second confirmation gates at 2026-09-27 19:35Z. This implementation PR contains the opt-in kernels and state-path changes. Evidence is reviewed in report PR #192.ssmoff297_confirm872.py pairrunner, submitted throughsubtasks/flashnext-ssmoff-20260926/analysis/hot-reference854-control/submit_confirm872_gpu.py, ran same-job, same-card stock → factor 900-second windows at C1×3/C8×2/C16×1. Directive Add more unit tests to CI sgl-project/sglang#880 added exactly two C16 pairs throughsubmit_confirm880_gpu.py, retaining the original window and namespace. Commands, controls, admission hashes and all eight job receipts are in docs/117.AttributeError: 'NoneType' object has no attribute 'evict'sgl-project/sglang#854 rejudgment. The original final C16 window also had official P90 −0.230621%, despite decode-only P90 +4.277378%; this negative observation remains in the report.gdn_backend.forward_extend → gdn_prefill_qkv_prepare.prepare → factored_qk_readycombines mixed-QKV splitting with the existing Q/K L2 operations and skips the duplicate backend normalization. V is copied. This path is prefill-only. At the original C16 P90 boundary request, TTFT improved 96.503 ms while decoding grew 1,113.023 ms; the decomposition identifies mixed scheduling and completion-cohort effects, not additional normalization arithmetic or a proved single-kernel stall.All eight confirmation pairs are retained. Each entry below is the ratio of equal-weight window means and its paired-window bootstrap 90% interval. C8 has the two windows authorized by sgl-project#872; intervals are descriptive.
Official P90 =
1/P90(E2EL/OSL); decode-only =1/P90((E2EL−TTFT)/(OSL−1)). All pooled changes are nonnegative. Eight pairs cost 23.068889 allocated GPU-hours; the full line's closed total is 936.332222 GPU-hours. Supplemental jobs 901294/901295 ended 19:33:16/19:33:24Z, ahead of the 19:36–19:43Z ETA. Same-image admission tests, scalar cohort checks and attribution checks passed; exact receipts remain linked in the report.Review docs/117, the final decision, and the seven-cell factor curve.
The report diff is restricted to docs/117, docs/figures, this line's subtasks and infra/aga scripts. No paper files, weights or raw jsonl are included. The 73 runtime/test paths excluded from this report are preserved at tooling commit
30b9b9a45889b5f92f3a4099244548bfdbeddd05onflashnext-ssmoff-20260926-tools, with a reconstruction patch; measured fork and remote runtime are unchanged.This admission covers the factor arm, which has no DUET component. Historical composite curves use v3-r4096-b. The k31-r4096-u batch has 9 independent numerical jobs and 14 both/latent performance cells prepared, pending K31U-READY and one same-image CPU preflight. Its admission is separate.
Fork CI is not green: the previous base run was blocked by draft status and lint reports local plus inherited formatting/registration issues. The audit and unapplied suggestions are recorded; the measured fork SHA remains frozen. Report PR sgl-project#192 is ready for Lead review. This implementation PR remains draft while its CI findings are outstanding; full experimental admission is complete.
CI States
Latest PR Test (Base): ❌ Run #36320000788
Latest PR Test (Extra): ❌ Run #36320000644