Skip to content

Commit e36343d

Browse files
authored
[FDConfig]Turn on the CUDAGraph + PD Disaggregation switch (PaddlePaddle#4530)
1 parent 9dc5c3e commit e36343d

File tree

1 file changed

+0
-5
lines changed

1 file changed

+0
-5
lines changed

fastdeploy/config.py

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1510,11 +1510,6 @@ def postprocess(self):
15101510
self.structured_outputs_config.guided_decoding_backend = "xgrammar"
15111511

15121512
# Adjustment GraphOptConfig
1513-
if self.scheduler_config.splitwise_role != "mixed":
1514-
self.graph_opt_config.use_cudagraph = False
1515-
logger.info(
1516-
"CUDAGraph does not support to be started together with PD Disaggregation temporarily, but has been automatically closed!"
1517-
)
15181513
if self.load_config is not None and self.load_config.dynamic_load_weight is True:
15191514
self.graph_opt_config.graph_opt_level = 0
15201515
logger.info(

0 commit comments

Comments
 (0)