Repository navigation

feat(plugin): DeepSeek-V4.1-Flash on the vLLM plugin, with LMCache byte offload - #2357

Closed

PerryZhang01 wants to merge 232 commits into

mainfrom

perzhang/dsv41-flash-vllm-plugin-20260922

Closed

feat(plugin): DeepSeek-V4.1-Flash on the vLLM plugin, with LMCache byte offload#2357
PerryZhang01 wants to merge 232 commits into
mainfrom
perzhang/dsv41-flash-vllm-plugin-20260922

Commits on Sep 30, 2026
- fix(plugin): hold the deferred-save clock on the slotted SeqView
  
  zgplvyou
  and
  cursoragent
  committed
  6e324c8
- fix(plugin): keep a GLM indexer in its attention layer's group
  
  zgplvyou
  and
  cursoragent
  committed
  597611a
- fix(offload): release a retrieved chunk's lookup pin once
  
  zgplvyou
  and
  cursoragent
  committed
  9214a5b
- fix(plugin): define the cudagraph padding rows of sparse-MLA output
  
  zgplvyou
  and
  claude
  committed
  15ef92d
- style: satisfy Black and Ruff on this branch's test files
  
  zgplvyou
  and
  claude
  committed
  b28c24d
- fix(plugin): define the cudagraph padding rows of dense-MLA output
  
  zgplvyou
  and
  claude
  committed
  ce99402
- fix(offload): order staging transfers against the compute stream
  
  zgplvyou
  and
  claude
  committed
  0100016
- fix(offload): keep the compute-stream fence off the no-CUDA test path
  
  zgplvyou
  and
  claude
  committed
  49e9e4d
- fix(offload): name the chunk size that works when it must be a block multiple
  
  zgplvyou
  and
  claude
  committed
  8b33721
- fix(offload): fence staging against the stream the forward actually runs on
  
  zgplvyou
  and
  claude
  committed
  558183c
- test(offload): pin the fence to the recorded stream, not the thread-local one
  
  zgplvyou
  and
  claude
  committed
  797f9f1
- offload: correct _note_compute_stream docstring to name its real call site
  
  zgplvyou
  and
  claude
  committed
  ec0ef77
- model_ops: zero the aiter topK meta buffer instead of leaving it uninitialized
  
  zgplvyou
  and
  claude
  committed
  1e0e516
- offload: fence the staging streams against the compute stream both ways
  
  zgplvyou
  and
  claude
  committed
  a46cc89
- recipes: record the cache-validation-shape result for GLM-5.3
  
  zgplvyou
  and
  claude
  committed
  de876de
- fix(docker): pin xgrammar to 0.2.7 so vLLM can import
  
  zgplvyou
  and
  cursoragent
  committed
  9409bb3
- recipes: fill in the GLM-5.3 conc-16 ON cell
  
  zgplvyou
  and
  claude
  committed
  937aee5
- recipes: replace the Kimi-K3 measured section with the PR #2369 numbers
  
  zgplvyou
  and
  claude
  committed
  0ddd9b3
- docs(recipes): keep only the perf sweep, the accuracy run, and how to read it
  
  zgplvyou
  and
  claude
  committed
  aae9f3f
- docs(recipes): bind the GLM-5.3 server to 8330, the port its client uses
  
  zgplvyou
  and
  claude
  committed
  74549d5
- docs(recipes): document the multiprocess LMCache tier as an alternative mode
  
  zgplvyou
  and
  claude
  committed
  b0a063f
- fix(docker): pin xgrammar to 0.2.7 so vLLM can import
  
  zgplvyou
  and
  cursoragent
  committed
  e766967
- docs(recipes): size the K3 multiprocess LMCache tier from measurement
  
  zgplvyou
  and
  claude
  committed
  27c40d5
- feat(plugin): run the vLLM offload connector on ATOM's MP LMCache tier
  
  zgplvyou
  and
  claude
  committed
  f886a0d
- feat(offload/mp): carry recurrent state in the PAGE transfer object
  
  zgplvyou
  and
  claude
  committed
  35f8681
- feat(plugin/mp): publish the recurrent groups to the MP server
  
  zgplvyou
  and
  claude
  committed
  6607b20
- feat(plugin/mp): ride the recurrent state on the PAGE transfer
  
  zgplvyou
  and
  claude
  committed
  c7a09f5
- test(plugin/mp): pin the rides_page planner's two block sources
  
  zgplvyou
  and
  claude
  committed
  81b69f2
- fix(plugin/mp): default state_transport from whether a pool was sized
  
  zgplvyou
  and
  claude
  committed
  7871d1d
- fix(offload/mp): null a recurrent chunk with block 0, not -1
  
  zgplvyou
  and
  claude
  committed
  874dc0d
- fix(plugin/mp): give back a ride's source pin when its save retires
  
  zgplvyou
  and
  claude
  committed
  435754c
- fix(plugin/mp): reconcile ride pins from the step the plugin actually drives
  
  zgplvyou
  and
  claude
  committed
  83f26a7
- fix(plugin): release a parked request whose load is never dispatched
  claude
  committed
  d046a2b
Commits on Oct 1, 2026
- fix(offload/mp): keep per-process placement out of the PAGE namespace
  
  zgplvyou
  and
  claude
  committed
  e9a43c3
- feat(offload/mp): support engine_driven transfers, on an unshared step event
  
  zgplvyou
  and
  claude
  committed
  fd21fcb
- feat(plugin/mp): say which gate declined a ride, and what the save leg holds
  
  zgplvyou
  and
  claude
  committed
  0e93f14
- docs(recipes): document and measure the ATOM MP LMCache backend on K3
  
  zgplvyou
  and
  claude
  committed
  d6925ea
Commits on Oct 2, 2026
- feat(plugin): run DeepSeek-V4.1-Flash text path on the vLLM plugin
  
  zgplvyou
  and
  claude
  committed
  dccccd5
- feat(offload): give DeepSeek-V4.1 its own state-owning offload layout
  
  zgplvyou
  and
  claude
  committed
  df1bc5a
- feat(plugin/offload): register DeepSeek-V4.1's PAGE planes with the byte codec
  
  zgplvyou
  and
  claude
  committed
  fd19d1b
- fix(plugin/offload): default the V4.1 flags at class level
  
  zgplvyou
  and
  claude
  committed
  4c6b8fa
- feat(plugin/offload): a STATE tier for DeepSeek-V4.1's per-request CSA2 state
  
  zgplvyou
  and
  claude
  committed
  e463838
- feat(plugin/offload): wire DeepSeek-V4.1's STATE leg into the connector
  
  zgplvyou
  and
  claude
  committed
  7bb1bd5
- fix(plugin/offload): snapshot V4.1's state before the forward, not after
  
  zgplvyou
  and
  claude
  committed
  390292a
- fix(plugin/offload): feed V4.1's load results back to its index
  
  zgplvyou
  and
  claude
  committed
  4bd4bf9
- fix(plugin/offload): a V4.1 state reservation may be refused, never stolen
  
  zgplvyou
  and
  claude
  committed
  549b6c7
- fix(plugin/offload): assign must not evict a reserved V4.1 state slot
  
  zgplvyou
  and
  claude
  committed
  429e8c2
- docs(recipes): measure DeepSeek-V4.1 LMCache byte offload on the vLLM plugin
  
  zgplvyou
  and
  claude
  committed
  ad98bea
Commits on Oct 3, 2026
- fix(plugin): V4.1's proxy layer needs V4's non-immediate block reuse
  
  zgplvyou
  and
  claude
  committed
  ce64d86
- docs(recipes): pin the V4.1 concurrency fault to chunked prefill
  
  zgplvyou
  and
  claude
  committed
  8c43559
- fix(plugin): build V4.1's spans from one source, and check the other
  
  zgplvyou
  and
  claude
  committed
  43a8631
- diag(plugin): dump every column a V4.1 stale-cursor refusal spans
  
  zgplvyou
  and
  claude
  committed
  2691331
- fix(deepseek_v41): render the stale-slot verdict in the step that asks for it
  
  zgplvyou
  and
  claude
  committed
  55a4ea9
- docs(recipes): three working points, and why concurrency costs the tier
  
  zgplvyou
  and
  claude
  committed
  f217bc0
- feat(plugin): admit prefix caching for V4.1 when the state tier owns its state
  
  zgplvyou
  and
  claude
  committed
  0c8b225
- fix(plugin): install V4.1's local-hit cap where the platform hook is not
  
  zgplvyou
  and
  claude
  committed
  6313501
- fix(plugin): refuse V4.1's local prefix-cache hits, do not shorten them
  
  zgplvyou
  and
  claude
  committed
  5be7f11
- docs(recipes): what enabling prefix caching on V4.1 actually costs
  
  zgplvyou
  and
  claude
  committed
  c4c9c7c
- feat(plugin): end V4.1 prefill chunks on a CSA2 state boundary
  
  zgplvyou
  and
  claude
  committed
  25028a5
- docs(recipes): prefill alignment, with the budget's own effect separated
  
  zgplvyou
  and
  claude
  committed
  e4fa24f
- docs(recipes): mark the concurrency-8 ratio as single-seed until paired
  
  zgplvyou
  and
  claude
  committed
  cdd9aee
- docs(recipes): pair both seeds at concurrency 8
  
  zgplvyou
  and
  claude
  committed
  347d67c
- test(plugin): tie V4.1's hardcoded speculative_tokens=0 to the refusal
  
  zgplvyou
  and
  claude
  committed
  e18d4a2
- test(plugin): check the V4.1 scheduler patches by their wiring
  
  zgplvyou
  and
  claude
  committed
  08f5991
- fix(plugin/offload): stop counting a restored prefix as boundaries lost
  
  zgplvyou
  and
  claude
  committed
  cf78736
- perf(plugin/offload): read V4.1's cursors once per batch, not once per store
  
  zgplvyou
  and
  claude
  committed
  196338e
- docs(recipes): refresh the alignment counters after the restored-start fix
  
  zgplvyou
  and
  claude
  committed
  9fe8ebd
- docs(recipes): the platform hook carries two more things, unverified
  
  zgplvyou
  and
  claude
  committed
  a1ace10
- docs(recipes): zero log lines is underdetermined, say what to rule out
  
  zgplvyou
  and
  claude
  committed
  e5f0519
- fix(plugin/offload): six defects found reviewing this branch
  
  zgplvyou
  and
  claude
  committed
  64c9a54
- Merge origin/main into the V4.1 offload branch
  
  zgplvyou
  and
  claude
  committed
  77a5d54
Commits on Oct 4, 2026
- fix(plugin/offload): the five remaining review findings
  
  zgplvyou
  and
  claude
  committed
  8b406af
- docs(recipes): add the current tree's own measurement, unresolved gap and all
  
  zgplvyou
  and
  claude
  committed
  ae6e0d1
- fix(plugin/offload): release only the V4.1 reservations nobody claimed
  
  zgplvyou
  and
  claude
  committed
  d5d71b0
- docs(recipes): final numbers, and the regression the re-measurement caught
  
  zgplvyou
  and
  claude
  committed
  e4792ad
- Take DeepSeek-V4.1 to the edge of cudagraph capture, and stop there on purpose
  
  zgplvyou
  and
  claude
  committed
  be45842
Commits on Oct 8, 2026
- feat(plugin): run DeepSeek-V4.1-Flash text path on the vLLM plugin
  
  zgplvyou
  and
  claude
  committed
  e1665fe
- fix(plugin): build V4.1's spans from one source, and check the other
  
  zgplvyou
  and
  claude
  committed
  eb790a1
- diag(plugin): dump every column a V4.1 stale-cursor refusal spans
  
  zgplvyou
  and
  claude
  committed
  468d23e
- fix(deepseek_v41): render the stale-slot verdict in the step that asks for it
  
  zgplvyou
  and
  claude
  committed
  644c6d7
- fix(plugin): V4.1's proxy layer needs V4's non-immediate block reuse
  
  zgplvyou
  and
  claude
  committed
  94d11a3
- fix(plugin): the V4.1 review findings this path owns
  
  zgplvyou
  and
  claude
  committed
  9cab6ad
- Take DeepSeek-V4.1 to the edge of cudagraph capture, and stop there on purpose
  
  zgplvyou
  and
  claude
  committed
  caba51e
- feat(plugin): refuse every KV connector for V4.1 on the plugin path
  
  zgplvyou
  and
  claude
  committed
  441ce62
- style: Black and Ruff on the files this branch authors
  
  zgplvyou
  and
  claude
  committed
  48b1096
- docs(recipes): the V4.1 plugin accuracy number is inherited, not this tree's
  
  zgplvyou
  and
  claude
  committed
  f11d4e3
- fix(plugin): V4.1's proxy answers block sizes with or without a spec
  
  zgplvyou
  and
  claude
  committed
  c9bb308
- fix(plugin): bind V4.1's proxy pool from the allocation, not the view
  
  zgplvyou
  and
  claude
  committed
  491dc00
- fix(deepseek_v41): size the scorer plane for the candidate list too
  
  zgplvyou
  and
  claude
  committed
  72ca470
Commits on Oct 9, 2026
- Merge the LMCache offload layer onto the 0.31-ready plugin base
  
  zgplvyou
  and
  claude
  committed
  4b31280
- Tell vLLM 0.31 which blocks a transfer is about to hand back
  
  zgplvyou
  and
  claude
  committed
  216f6d7
- Judge the K/V axis by contiguity, not by a size-2 dim 1
  
  zgplvyou
  and
  claude
  committed
  1c5dafd
- Make "every cache is offloaded" a claim the registration can refute
  
  zgplvyou
  and
  claude
  committed
  6f80950
- Report V4.1 stores the tier could not take, instead of dropping them
  
  zgplvyou
  and
  claude
  committed
  882c4e9
- Report load failures by request where vLLM 0.31 refuses block ids
  
  zgplvyou
  and
  claude
  committed
  4fa585d
- Give the STATE grid a spacing and an anchor, so short prompts exist in it
  
  zgplvyou
  and
  claude
  committed
  9fd969e
- Let the arena balance to within its padding, and cover the V2 model runner
  
  zgplvyou
  and
  claude
  committed
  3b6c00d
- feat(plugin): run DeepSeek-V4.1-Flash text path on the vLLM plugin
  
  zgplvyou
  and
  claude
  committed
  9a3c7a8
- fix(plugin): build V4.1's spans from one source, and check the other
  
  zgplvyou
  and
  claude
  committed
  1229e7b
- diag(plugin): dump every column a V4.1 stale-cursor refusal spans
  
  zgplvyou
  and
  claude
  committed
  b955f7e
- fix(deepseek_v41): render the stale-slot verdict in the step that asks for it
  
  zgplvyou
  and
  claude
  committed
  6dedfbe
- fix(plugin): V4.1's proxy layer needs V4's non-immediate block reuse
  
  zgplvyou
  and
  claude
  committed
  e83cb68
- fix(plugin): the V4.1 review findings this path owns
  
  zgplvyou
  and
  claude
  committed
  76fc2e3
- Take DeepSeek-V4.1 to the edge of cudagraph capture, and stop there on purpose
  
  zgplvyou
  and
  claude
  committed
  e9f3cc3
- feat(plugin): refuse every KV connector for V4.1 on the plugin path
  
  zgplvyou
  and
  claude
  committed
  36c7c6a
- style: Black and Ruff on the files this branch authors
  
  zgplvyou
  and
  claude
  committed
  fe50f8a
- docs(recipes): the V4.1 plugin accuracy number is inherited, not this tree's
  
  zgplvyou
  and
  claude
  committed
  34194f7
- fix(plugin): V4.1's proxy answers block sizes with or without a spec
  
  zgplvyou
  and
  claude
  committed
  ca391e5
- fix(plugin): bind V4.1's proxy pool from the allocation, not the view
  
  zgplvyou
  and
  claude
  committed
  7bda26b
- fix(deepseek_v41): size the scorer plane for the candidate list too
  
  zgplvyou
  and
  claude
  committed
  01c8f46
- feat(deepseek_v41): give attention a caller-owned output and an eager break
  
  zgplvyou
  and
  claude
  committed
  0417ec5
- fix(deepseek_v41): size the attention buffer per token, not per sequence
  
  zgplvyou
  and
  claude
  committed
  2e09719
- fix(plugin): V4.1's bind must not run against the memory profile's pool
  
  zgplvyou
  and
  claude
  committed
  d51d242
- fix(plugin): install the profile-cache patch for every model, not for V4's
  
  zgplvyou
  and
  claude
  committed
  9aee15f
- fix(plugin): V4.1's bind stands down while cudagraphs are captured
  
  zgplvyou
  and
  claude
  committed
  a17701f
- fix(plugin): do not open ATOM's side-stream fork under vLLM's capture
  
  zgplvyou
  and
  claude
  committed
  b17555a
- docs(recipes): on 0.31 the capture does not finish, and here is what it is not
  
  zgplvyou
  and
  claude
  committed
  83999fe
- fix(plugin): the profile-cache patch must reach the runner the worker builds
  
  zgplvyou
  and
  claude
  committed
  15a6906
- fix(plugin): V4.1's bind must not gate on vLLM's capture permission flag
  
  zgplvyou
  and
  claude
  committed
  bbaa757
- fix(engram): do not fork the staging prefetch when the capture can break
  
  zgplvyou
  and
  claude
  committed
  6356e75
- fix(plugin): give V4.1's warmup batch one STATE slot per row
  
  zgplvyou
  and
  claude
  committed
  433020f
- fix(plugin): V4.1's eager breaks must read this step, not the captured one
  
  zgplvyou
  and
  claude
  committed
  d317fca
- fix(plugin): every per-step decision V4.1 makes has to survive a replay
  
  zgplvyou
  and
  claude
  committed
  86898f9
- fix(plugin): the req_id pass-through has to follow the state the runner builds
  
  zgplvyou
  and
  claude
  committed
  866f122
- Merge main's 0.31 upgrade, and narrow the V2 profiling skip to V4.1
  
  zgplvyou
  and
  claude
  committed
  aaf5d70
- Bring DeepSeek-V4.1 up on the MP offload backend
  
  zgplvyou
  and
  claude
  committed
  c95454d
Commits on Oct 10, 2026
- feat(plugin): stage V4.1's step in the metadata builder so FULL can capture it
  
  zgplvyou
  and
  claude
  committed
  ac4af66
- refactor(plugin): keep this path's vLLM-only code in the plugin, and drop LMCache's
  
  zgplvyou
  and
  claude
  committed
  786539f
- fix(plugin): stage V4.1's step against the width vLLM will actually run
  
  zgplvyou
  and
  claude
  committed
  90a10c0
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  63de276
- Merge the plugin's V4.1 bring-up, and keep the connector it was built without
  
  zgplvyou
  and
  claude
  committed
  05ac97e
- fix(plugin): the cursor advance has to be owed to exactly one path
  
  zgplvyou
  and
  claude
  committed
  a1ea872
- fix(plugin): drop the dangling blocking-probe reference left by the merge
  
  zgplvyou
  and
  claude
  committed
  9df2817
- Merge the bring-up branch's capture fixes (a1ea872be)
  
  zgplvyou
  and
  claude
  committed
  b00b328
- Make "no STATE slot" say which of its two causes it is
  
  zgplvyou
  and
  claude
  committed
  06643da
- diag(plugin): count the cursor-advance branch by graph mode
  zgplvyou
  committed
  748640e
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  59fb087
- Name the STATE key space, because the offload leg cannot read the other one
  
  zgplvyou
  and
  claude
  committed
  a90beae
- fix(plugin): count a FULL batch's requests without its padding
  
  zgplvyou
  and
  claude
  committed
  a7cb78f
- Make the STATE boundary and the snapshot agree about which step they mean
  
  zgplvyou
  and
  claude
  committed
  bd15d7b
- Merge the FULL-graph fixes (a7cb78ffd)
  
  zgplvyou
  and
  claude
  committed
  aa8a44a
- Make the hit cap fail closed, as its own docstring already promised
  
  zgplvyou
  and
  claude
  committed
  42f7f51
- Make the row-alignment guard able to fire, and able to be right
  
  zgplvyou
  and
  claude
  committed
  08f120d
- Stop splitting a prompt that fits in one chunk, and the restore path works
  
  zgplvyou
  and
  claude
  committed
  a817c86
- feat(plugin): support DSpark speculative decoding for DeepSeek-V4.1
  
  zgplvyou
  and
  claude
  committed
  9d2f700
- Merge origin/main into the DSpark plugin branch
  
  zgplvyou
  and
  claude
  committed
  632876e
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  7c0ba84
- fix(plugin): turn decoder SWA bounded replay off when V4.1 speculates
  
  zgplvyou
  and
  claude
  committed
  378fd57
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  a39acfd
Commits on Oct 11, 2026
- feat(plugin): run DeepSeek-V4.1 CUDA graphs and DSpark together
  
  zgplvyou
  and
  claude
  committed
  fd9f2a1
- ci: cover DeepSeek-V4.1 on the vLLM plugin, with an acceptance gate
  
  zgplvyou
  and
  claude
  committed
  8a72e72
- Serve V4.1 local prefix hits from HBM, behind a flag that is off
  
  zgplvyou
  and
  claude
  committed
  a0e1ca6
- An admitted V4.1 prefix must have a state load behind it, or be refused
  
  zgplvyou
  and
  claude
  committed
  b9a1dee
- Merge remote-tracking branch 'origin/perzhang/dsv41-flash-vllm-plugin-nolmcache' into perzhang/dsv41-lmcache-031
  zgplvyou
  committed
  98ec7b8
- Follow the base's speculative support where this connector has not been
  
  zgplvyou
  and
  claude
  committed
  65a38dc
- Take the prompt-end anchor again: the split was never what broke it
  
  zgplvyou
  and
  claude
  committed
  bba8710
- Stop re-recording an interprocess event another process is waiting on
  
  zgplvyou
  and
  claude
  committed
  a8193a2
- Add the three-arm offload accuracy check, with the gates that make it mean something
  
  zgplvyou
  and
  claude
  committed
  abd431b
- Pre-register the on/off throughput design, before the numbers exist
  
  zgplvyou
  and
  claude
  committed
  c9a1003
- Make the gates print their decomposition instead of their verdict
  
  zgplvyou
  and
  claude
  committed
  a5e4cb7
- Make the pre-registered statistic a program, before the data arrives
  
  zgplvyou
  and
  claude
  committed
  aacb40f
- Correct the pre-registration's arithmetic, before the run rather than after
  
  zgplvyou
  and
  claude
  committed
  fde4039
- Measure the on/off pair in graph mode, to the design written beforehand
  
  zgplvyou
  and
  claude
  committed
  3b21870
Commits on Oct 12, 2026
- ci: record what the V4.1 cells' 8192-token limit does and does not cover
  
  zgplvyou
  and
  claude
  committed
  935b6c4
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  8501c78
- Check V4.1 against the shapes that break V4, and say what the check could see
  
  zgplvyou
  and
  claude
  committed
  d117d36
- Size a V4.1 checkpoint image, and refuse the two halves disagreeing
  
  zgplvyou
  and
  claude
  committed
  91ff9f3
- refactor: let the frontend state V4.1's execution facts instead of core asking
  
  zgplvyou
  and
  claude
  committed
  b741553
- refactor: move the external-pool knowledge out of the CSA2 cache
  
  zgplvyou
  and
  claude
  committed
  fca9b43
- Declare V4.1's image units as blocks vLLM will checkpoint and hash
  
  zgplvyou
  and
  claude
  committed
  4a8e730
- Move a V4.1 image through native's copier, at the boundaries vLLM picks
  
  zgplvyou
  and
  claude
  committed
  cabee52
- refactor: give the capture-held dummy cache to the frontend that needs it
  
  zgplvyou
  and
  claude
  committed
  53851d6
- fix: the staging-advance gate read the wrong object, and was constant
  
  zgplvyou
  and
  claude
  committed
  a14e006
- Register V4.1's image layers, and keep the gate shut until they are filled
  
  zgplvyou
  and
  claude
  committed
  dba5f94
- fix(engram): keep the prefetch overlapped under a capture that breaks
  
  zgplvyou
  and
  claude
  committed
  ce7de4d
- Address a V4.1 image the way the engine actually lays it out, and prove the bytes
  
  zgplvyou
  and
  claude
  committed
  50e8b25
- Wire the V4.1 image store, and stop at the restore reading the wrong column
  
  zgplvyou
  and
  claude
  committed
  643c8f4
- refactor: give the attention output buffer to the frontend that needs it
  
  zgplvyou
  and
  claude
  committed
  5811c2c
- Split the image read column from the write column, and find the path never runs
  
  zgplvyou
  and
  claude
  committed
  4963c84
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  cf9b208
- feat(plugin/dsv41): restore a prefix hit from its checkpoint image
  
  zgplvyou
  and
  claude
  committed
  e2cd367
- perf(plugin): let the layers join the Engram prefetch, not the builder
  
  zgplvyou
  and
  claude
  committed
  4813e32
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  1d2160b
- fix(plugin/dsv41): restore only the stale rows, and before the contract judges
  
  zgplvyou
  and
  claude
  committed
  abe192e
- fix(plugin/dsv41): register the image alignment vLLM's own test can pass
  
  zgplvyou
  and
  claude
  committed
  dd5fd8a
- debug(plugin/dsv41): read the counters at the refusal, not twenty seconds before it
  
  zgplvyou
  and
  claude
  committed
  bca4cf4
- fix(plugin/dsv41): delete the whole-batch image restore that erased live state
  
  zgplvyou
  and
  claude
  committed
  26c2ccc
- fix(plugin/dsv41): keep the state-image group out of the offload recurrent leg
  
  zgplvyou
  and
  claude
  committed
  def8b65
- fix(plugin/dsv41): the state-image group is neither recurrent nor attention
  
  zgplvyou
  and
  claude
  committed
  479ae3f
- docs(dsv41): record what the state-image run measured, including what it did not
  
  zgplvyou
  and
  claude
  committed
  2f47703
- feat(plugin/dsv41): cap a local hit to the checkpoint even with no connector
  
  zgplvyou
  and
  claude
  committed
  3ecb5ad
- test(mp): ask the event-pool predicate instead of reloading the module
  
  zgplvyou
  and
  claude
  committed
  15b4839
- fix(plugin/dsv41): refuse an unbacked local hit instead of taking down the engine
  
  zgplvyou
  and
  claude
  committed
  3183f25
- fix(plugin/dsv41): never store an image at a position its bytes are not from
  
  zgplvyou
  and
  claude
  committed
  8052c3b
- docs(dsv41): record the state-image / DSpark draft group collision
  
  zgplvyou
  and
  claude
  committed
  49a8685
- refactor(v41): drop the execution-policy module for a builder override
  
  zgplvyou
  and
  claude
  committed
  c8e2f0f
- refactor(v41): fold thirteen plugin modules into six
  
  zgplvyou
  and
  claude
  committed
  0540276
- fix(v41): clear the two CI style and collection failures
  
  zgplvyou
  and
  claude
  committed
  0d0dda1
- fix(plugin/dsv41): stop promising vLLM a checkpoint this backend cannot export
  
  zgplvyou
  and
  claude
  committed
  19456a4
- docs(v41): state why prefix caching is refused, not just that it is
  
  zgplvyou
  and
  claude
  committed
  43c7cec
- fix(plugin/dsv41): stop writing images nothing will read, and stop leaking test state
  
  zgplvyou
  and
  claude
  committed
  849a6aa
- Merge remote-tracking branch 'origin/perzhang/dsv41-flash-vllm-plugin-nolmcache' into perzhang/dsv41-lmcache-031
  zgplvyou
  committed
  0134e50
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  5c43309
- fix(v41): give the bridge's batches the fields _prepare now reads
  
  zgplvyou
  and
  claude
  committed
  da446ba
Commits on Oct 13, 2026
- docs(dsv41): cut the recipe to the command, the method and the numbers
  
  zgplvyou
  and
  claude
  committed
  50aa31c
- fix(v41): the three P1s and the null-block boundary from review
  
  zgplvyou
  and
  claude
  committed
  4ebafcf
- fix(v41): the remaining P2s from review that measurement confirmed
  
  zgplvyou
  and
  claude
  committed
  732d6e0
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  80f2274
- fix(v41): refuse --hf-overrides instead of attempting a normalization that cannot work
  
  zgplvyou
  and
  claude
  committed
  f360479
- Merge remote-tracking branch 'origin/main' into perzhang/dsv41-flash-vllm-plugin-nolmcache
  zgplvyou
  committed
  2aab1f7
- fix(v41): refuse DSpark without a draft KV dtype, naming the flag
  
  zgplvyou
  and
  claude
  committed
  2685e5e
- fix(plugin/dsv41): claim the proxy's kv-cache group by name, and measure DSpark
  
  zgplvyou
  and
  claude
  committed
  c357dcb
- Merge remote-tracking branch 'origin/perzhang/dsv41-flash-vllm-plugin-nolmcache' into perzhang/dsv41-lmcache-031
  zgplvyou
  committed
  ae0b6eb
- fix: finish the merge that was committed with its markers still in
  
  zgplvyou
  and
  claude
  committed
  7080b6a
- fix: take the sibling branch's definition along with its call site
  
  zgplvyou
  and
  claude
  committed
  d7ecade
- fix(offload): price block coverage at the strided group's block size
  
  zgplvyou
  and
  claude
  committed
  94b22da
- fix(plugin/dsv41): split the hash unit from the boundary grid
  
  zgplvyou
  and
  claude
  committed
  6d5bc5e
- fix(plugin/dsv41): clip the prefill chunk to the boundary grid, not the hash unit
  
  zgplvyou
  and
  claude
  committed
  4066b23
- fix(offload): withdraw a load that was dispatched and never reported
  
  zgplvyou
  and
  claude
  committed
  0b7260d
- debug(offload): make a dropped load completion say so
  
  zgplvyou
  and
  claude
  committed
  2de2fda
- fix(offload): preserve receive quorum and resolve PAGE identity before transport
  
  zgplvyou
  and
  claude
  committed
  d08f410
- fix(plugin): keep remote restore tails out of V4.1 verify steps
  
  zgplvyou
  and
  claude
  committed
  cfd3a98
- test(offload): validate real tier supply and pin workload process identity
  
  zgplvyou
  and
  claude
  committed
  1e3ecb5
- fix(plugin): recognize output-history replay in V4.1 steps
  
  zgplvyou
  and
  claude
  committed
  d27002f
- docs(offload): scope repeated recovery probes to the shared warm prefix
  
  zgplvyou
  and
  claude
  committed
  c54d056
- fix(offload): preserve token accounting for STATE byte objects
  
  zgplvyou
  and
  claude
  committed
  d1704f7
- fix(plugin): suppress new-admission padding in V4.1 steps
  
  zgplvyou
  and
  claude
  committed
  f29878c
- docs(offload): record graph DSpark regression and shutdown results
  
  zgplvyou
  and
  claude
  committed
  c118ea7
- fix(plugin): tie reused AITER collectives to TP owner lifecycle
  
  zgplvyou
  and
  claude
  committed
  3a97b16
- test(plugin): use real DSpark drafting input budget
  
  zgplvyou
  and
  claude
  committed
  10228cb
- docs(offload): record TP cleanup recheck and remaining teardown failure
  
  zgplvyou
  and
  claude
  committed
  fdb24d5
Commits on Oct 14, 2026
- test(offload): add fixed-contract clients and report DSpark acceptance
  
  zgplvyou
  and
  claude
  committed
  0d04026

Commits

Commits on Sep 30, 2026

Commits on Oct 1, 2026

Commits on Oct 2, 2026

Commits on Oct 3, 2026

Commits on Oct 4, 2026

Commits on Oct 8, 2026

Commits on Oct 9, 2026

Commits on Oct 10, 2026