Skip to content

Add integration with lws for multi-node inference - #3540

Closed
kerthcet wants to merge 1 commit into
sgl-project:mainfrom
kerthcet:doc/lws
Closed

kerthcet wants to merge 1 commit into
sgl-project:mainfrom
kerthcet:doc/lws

Conversation

@kerthcet

@kerthcet kerthcet commented Feb 13, 2025 •

Copy link
Copy Markdown

Motivation

Add introduction about how to serve sglang crossing nodes on kubernetes.

Modifications

Checklist

  • Format your code according to the Code Formatting with Pre-Commit.
  • Add unit tests as outlined in the Running Unit Tests.
  • Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
  • Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
  • For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.

@kerthcet

Copy link
Copy Markdown
Author

cc @ahg-g @yankay

@yankay

yankay commented Feb 13, 2025

Copy link
Copy Markdown
Contributor

cc @ahg-g @yankay

It's great change :)

Signed-off-by: kerthcet <kerthcet@gmail.com>
@kerthcet

Copy link
Copy Markdown
Author

kindly ping @zhyncs

@zhaochenyang20

Copy link
Copy Markdown
Collaborator

@kerthcet could you fix the conflicts? I will ask Yanbo to review this.

@github-actions github-actions Bot closed this May 30, 2025
@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been automatically closed due to inactivity. Please feel free to reopen it if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants