Skip to content

[Perf] [XPU] vae-layernorm-silu: add Xpu triton path to replace torch - #48792

Draft
MeowMiaoJ wants to merge 2 commits into
sgl-project:mainfrom
MeowMiaoJ:xpu4triton
Draft

MeowMiaoJ wants to merge 2 commits into
sgl-project:mainfrom
MeowMiaoJ:xpu4triton

Conversation

@MeowMiaoJ

@MeowMiaoJ MeowMiaoJ commented Nov 6, 2026 •

Copy link
Copy Markdown
Contributor

Motivation

This pull request adds XPU triton path of multiple kernels for better performance.

These changes collectively provide robust, high-performance support for LayerNorm modulation fusion on Intel XPU, with strong correctness guarantees and seamless integration into the model pipeline.

Modifications

  • Added XPU-optimized triton kernel support for LayerNorm modulation (xpu_layernorm_modulate).
  • Integrated triton path for apply_modulation, fused SiLU-mul and RMSNorm kernels to support both CUDA and XPU, and updated logic to detect and run on XPU devices.

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

CI States

Latest PR Test (Base): ❌ Missing run-ci label -- add it to run CI tests.
Latest PR Test (Extra): ❌ Blocked -- run-ci is required first.
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.

Tip

Base CI only covers the core cases, and its workload may not exercise your change. Use /rerun-test to run the tests your change touches, or copy this prompt for an agent:

Find the registered tests this PR affects and run them with /rerun-test, following https://github.com/sgl-project/sglang/blob/main/.agents/skills/rerun-test/SKILL.md

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion jit-kernel

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant