Skip to content

Commit 313e956

Browse files
committed
test
1 parent 0758aed commit 313e956

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

python/sglang/srt/custom_op.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,8 @@ def __init__(self):
1515
self._forward_method = self.dispatch_forward()
1616

1717
def forward(self, *args, **kwargs):
18+
if torch._dynamo.is_compiling:
19+
return self.forward_native(*args, **kwargs)
1820
return self._forward_method(*args, **kwargs)
1921

2022
def forward_native(self, *args, **kwargs):

0 commit comments

Comments
 (0)