Skip to content

Commit 15e91d7

Browse files
authored
Tiny fix DeepseekScalingRotaryEmbedding always use forward_native (#5406)
1 parent 8aab7fd commit 15e91d7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

python/sglang/srt/layers/rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -649,7 +649,7 @@ def forward_hip(self, *args, **kwargs):
649649
return self.forward_native(*args, **kwargs)
650650

651651
def forward(self, *args, **kwargs):
652-
if torch._dynamo.is_compiling:
652+
if torch.compiler.is_compiling():
653653
return self.forward_native(*args, **kwargs)
654654
if _is_cuda_available:
655655
return self.forward_cuda(*args, **kwargs)

0 commit comments

Comments
 (0)