Repository navigation
Commit e85978a
perf(amd): Kimi-K3.1 MI355X vLLM AgentX: image kimi-k31-5c14fe8, SP prefill, c1/c4 decode levers
Bump the image to vllm/vllm-openai-rocm:kimi-k31-5c14fe8 (mum-tracking
5c14fe8de: seungrokj/mum#26 and seungrokj/mum#28 on top of 6d74a152f).
Enable VLLM_K3_SP_PREFILL on every point, and set the latency_specialized
decode levers explicitly at concurrency 1 and 4.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>1 parent 879bb37 commit e85978a
3 files changed
Lines changed: 30 additions & 1 deletion
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/kimik3.1/vllm/mi355x-fp4-mtp
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
72 | 72 | | |
73 | 73 | | |
74 | 74 | | |
| 75 | + | |
| 76 | + | |
75 | 77 | | |
76 | 78 | | |
77 | 79 | | |
| |||
120 | 122 | | |
121 | 123 | | |
122 | 124 | | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
123 | 134 | | |
124 | 135 | | |
125 | 136 | | |
| |||
137 | 148 | | |
138 | 149 | | |
139 | 150 | | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
140 | 158 | | |
141 | 159 | | |
142 | 160 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
974 | 974 | | |
975 | 975 | | |
976 | 976 | | |
977 | | - | |
| 977 | + | |
978 | 978 | | |
979 | 979 | | |
980 | 980 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12898 | 12898 | | |
12899 | 12899 | | |
12900 | 12900 | | |
| 12901 | + | |
| 12902 | + | |
| 12903 | + | |
| 12904 | + | |
| 12905 | + | |
| 12906 | + | |
| 12907 | + | |
| 12908 | + | |
| 12909 | + | |
| 12910 | + | |
| 12911 | + | |
0 commit comments