Skip to content

Commit 200c598

Browse files
author
=
committed
fix
1 parent 30aa15f commit 200c598

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

python/sglang/srt/sampling/sampling_batch_info.py

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -90,7 +90,14 @@ def from_schedule_batch(cls, batch: ScheduleBatch, vocab_size: int):
9090
device, non_blocking=True
9191
)
9292
thinking_budgets = torch.tensor(
93-
[r.sampling_params.thinking_budget or -1 for r in reqs],
93+
[
94+
(
95+
r.sampling_params.thinking_budget
96+
if r.samping_params.thinking_budget is not None
97+
else -1
98+
)
99+
for r in reqs
100+
],
94101
dtype=torch.int64,
95102
).to(device, non_blocking=True)
96103
else:

0 commit comments

Comments
 (0)