https://github.com/sgl-project/sglang/blob/f652494df16ef9fa0fac998ddf63961aee0849d4/python/sglang/srt/utils.py#L212
Activity
merrymercy commentedon Jan 16, 2024
Please submit a PR. Thanks!
Ying1123 commentedon Jan 16, 2024
Solved by #15
Sequence Parallel Decode Attn Kernel (#5)
Updated unit tests for general device-agnostic compatibility. (sgl-pr…
Merge pull request sgl-project#5 from NorthmanPKU/tb_red_jjn
Merge pull request sgl-project#5 from ZailiWang/main
Rebase internal with fp8 support (sgl-project#5)
add draft and base model (#5)
68 remaining items
[Fix] hicache: Always enter storage sync collectives after a failure
[Fix] hicache: Liveness over started workers, a 300 s sync timeout, a…
MERGE-5 repair: restore parent_node_id core method + mamba_value_seql…
docs(stack): entry 319 -- MERGE-5 cargo repair, header qwennext-stack…
docs(stack): MEASURE the entry-319 python consequences (docs-only; co…
TLFIX: silence TileLang data-race false-positive on QSA relative-pref…
docs(stack): entry 320 TLFIX landed (e9f0ae1) -- header qwennext-stac…
Merge pull request sgl-project#5 from sigama-w/hicache-sparse-copy
MERGE: sixth merge taken from sgl-project/sglang main @ eb73a50 (+950…
MERGE-6 B1: all 12 diffusion-zone re-plant markers consumed -- 4 re-p…
MERGE-6 B3 C1-hybrid: hybrid_cache_controller re-plant -- THE CLAMP b…
MERGE-6 B5 C3: nvfp4 defer-arms union + fp8 refined-block w13-grid re…
MERGE-6 B6 C2: server_args field-order 6F -> 0F, zone=b6 marker censu…
MERGE-6 B6 C4: budget contract RESTORED via UNION-RE-ANCHOR -- direct…
SGLANG_HANDOFF.md: add §12.6 (sglang protobuf regression) + §12.7 (vL…