Repository navigation
[Scheduler] Replace extend_range with extend_end derived from prefix_len - #42822
Merged
Merged
Conversation
hnyls2002
requested review from
ByronHsu,
ClawSeven,
Duyi-Wang,
Fridge003,
HaiShaw,
ShangmingCai,
Ying1123,
alphabetc1,
hanming-lu,
huangtingwei9988,
hzh0425,
ispobock,
merrymercy,
rwang5203,
sogalin,
xiezhq-hermann,
yeahdongcn and
yizhang2077
as code owners
October 6, 2026 22:12
Collaborator
Author
|
/rerun-test registered/unit/managers/test_hisparse_unit.py |
Contributor
|
🚀 |
hnyls2002
force-pushed
the
lsyin/prefix-writer
branch
from
October 7, 2026 22:55
6a87e03 to
3b27d73
Compare
hnyls2002
force-pushed
the
lsyin/extend-end
branch
from
October 7, 2026 22:58
d38a0fe to
4d1a22e
Compare
hnyls2002
force-pushed
the
lsyin/prefix-writer
branch
from
October 7, 2026 22:59
3b27d73 to
14e6c42
Compare
hnyls2002
force-pushed
the
lsyin/extend-end
branch
from
October 7, 2026 23:04
4d1a22e to
426f555
Compare
vincentzed
pushed a commit
to vincentzed/sglang
that referenced
this pull request
Oct 8, 2026
main dropped Req.prefix_indices and Req.extend_range (sgl-project#42822, sgl-project#42824, sgl-project#42825) and moved the cache match into match_kv_cache. The replay bookkeeping now lives in match_kv_cache and uses req.prefix_len. The request stubs of two scheduler unit tests get the new replay fields.
detain
added a commit
to detain/sglang
that referenced
this pull request
Oct 10, 2026
…chunk_alignment) Ported sgl-project#42767 (74bee49 + style 25b56c3, squashed). The PR was written against the pre-sgl-project#42822/sgl-project#42825 scheduler API; ported len(req.prefix_indices) -> req.prefix_len and the two tests from extend_range to (prefix_len, extend_end). Gating verdict: NOT hip-gated -- CUDA-visible by design. The alignment only activates when the KV pool exposes prefill_chunk_alignment > 1 (default 1 = exact upstream behavior); QSATokenToKVPool is the only pool that does (page_size), i.e. the compression-group invariant owned by stack entries 118/121/125. For prod QSA (page 128) this now prevents budget-truncated continuation chunks from ending mid-page/mid-group; full prefill-adder battery stays green (51P+48sub).
nvpohanh
added a commit
to nvjullin/sglang
that referenced
this pull request
Oct 12, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
5 tasks
5 tasks done
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 21, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 21, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 21, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 27, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 27, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 29, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Oct 29, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Nov 4, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvjullin
pushed a commit
to nvjullin/sglang
that referenced
this pull request
Nov 4, 2026
- Rust bindings: pyo3 0.29 renamed Python::allow_threads to detach. - Serialized load-back: sgl-project#43206 dropped anchor_index_parts and the FULL-anchored SWA device binding, so SWA rows are allocated independently and the per-node rebase helper (and its test) is obsolete. - Tests: sgl-project#42822 replaced Req.set_extend_range/extend_range and prefix_indices with prefix_len/extend_end, and MatchResult now carries device_prefix_len instead of device_indices; init_load_back returns the loaded length. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Req.extend_end;extend_lenisextend_end - prefix_len; removeRangeextend_lens/prefix_lens, which already carry mixed-decode and encoder adjustments; drop the encoder start shiftCI States
Latest PR Test (Base): 🚫 Run #37700074645
Latest PR Test (Extra): 🚫 Run #37700074368
Latest PR Test (AMD ROCm 10): 🚫 Run #37700074593