You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature] Add alternative names for pp-size, tp-size, and dp-size #893
Probably a bit immature but I just had a meeting with a coworker to explain the options for sglang. I really don't want to say pp-size at work again......
Can we modify the options to include pipeline-parallel-size, tensor-parallel-size, and data-parallel-size like vLLM do? We can still keep the old ones for back compatibility.
Activity
zhyncs commentedon Aug 2, 2024
Make sense.
merrymercy commentedon Aug 3, 2024
@w013nad Could you contribute a PR to fix this?
yichuan-w commentedon Aug 5, 2024
@w013nad #941 supports that now
Merge fix/893-stranding-true-w (sgl-project#893, price a stranded dec…
[sgl-project#898] Re-pin the pp_with_spec evidence cites the train's …
Train hygiene: clear the 22 UP037 the pre-commit hook selects