Skip to content

Commit 4839999

Browse files
authored
Overlap two kernels in DeepSeek with communication (#6711)
1 parent 541a985 commit 4839999

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

python/sglang/srt/operations_strategy.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,9 +127,9 @@ def _compute_moe_deepseek_blog_decode(layer):
127127
layer.mlp.op_combine_a,
128128
operations.YieldOperation(),
129129
layer.mlp.op_combine_b,
130+
operations.YieldOperation(),
130131
layer.mlp.op_output,
131132
layer.op_comm_postprocess_layer,
132-
operations.YieldOperation(),
133133
],
134134
)
135135

0 commit comments

Comments
 (0)