Repository navigation
Commit 1bb3393
refactor(offload): let the shared scheduler name where a load starts
main's #2332 made ChunkedOffloadSchedulerBase set
seq.offload_load_start_tokens = hbm right before it creates each load
operation, so every chunked offload scheduler publishes a restored prefix
into the HBM prefix index. mooncake_store's _new_load_operation override
set the same value (seq.num_cached_tokens, which is that hbm) and is now
redundant. The dense-scheduler test no longer asserts that the attribute
is absent, since main sets it there on purpose.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>1 parent 52c3f02 commit 1bb3393
2 files changed
Lines changed: 0 additions & 14 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
481 | 481 | | |
482 | 482 | | |
483 | 483 | | |
484 | | - | |
485 | | - | |
486 | | - | |
487 | | - | |
488 | | - | |
489 | | - | |
490 | | - | |
491 | | - | |
492 | | - | |
493 | | - | |
494 | | - | |
495 | | - | |
496 | | - | |
497 | 484 | | |
498 | 485 | | |
499 | 486 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1740 | 1740 | | |
1741 | 1741 | | |
1742 | 1742 | | |
1743 | | - | |
1744 | 1743 | | |
1745 | 1744 | | |
1746 | 1745 | | |
| |||
0 commit comments