Skip to content

Commit 569b032

Browse files
authored
[PD] Tiny fix timeout error when generate (#5545)
1 parent f6a7113 commit 569b032

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

python/sglang/srt/disaggregation/mini_lb.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,11 @@ async def generate(
2626
self, modified_request, prefill_server, decode_server
2727
) -> ORJSONResponse:
2828

29-
async with aiohttp.ClientSession() as session:
29+
async with aiohttp.ClientSession(
30+
timeout=aiohttp.ClientTimeout(
31+
total=3600
32+
) # Add timeout for request reliability
33+
) as session:
3034
tasks = [
3135
session.post(f"{prefill_server}/generate", json=modified_request),
3236
session.post(f"{decode_server}/generate", json=modified_request),

0 commit comments

Comments
 (0)